I would sure try to talk to him first; a friendly talk will usually solve problems like that. Who owns the land? If it is a lease from a paper company, most of them have a clause that forbid hunting within a certain distance of the property line.
What he said.
A few years ago we found stands on the property lines and corn on piled on their side. You could see it easy from our side. Anyway, they were leasing from the paper company, a single phone call took care of it since baiting was against the rules and so was hunting within 50 yards of the property lines. Easy fix.
Another time we had a guy baiting and hunting the line, we simply called the GW and he came in a wrote the man a ticket on the bow season opener. Found out later it was the president of the club. Go figure. It got ugly after that though. The club would walk the line talking loud all the time just to disturb our hunting. My father owned the 40 acres we were on and they had the back boundry. We had killer food plots and they had woods only. With all the GW traffic and the hunting clubs bothering us, we didn't kill squat that year. Really sucked.