When I try to pull some site’s data, like bloomberg.com, it recognizes it as a crawler bot and prevents the real page’s data from showing. For example:
Bloomberg - Are you a robot?We’ve detected unusual activity from your computer network
To continue, please click the box below to let us know you’re not a robot.
But if you post this url to twitter or slack, it is able to pull the image and title. So i wonder if there is a way to fix this or prevent this issue?
Thanks
