If you want to run a site audit and monitor your site health using SearchAtlas, sometimes our site crawlers get blocked by CDNs. Content Delivery Networks (CDNs) […]
If you want to run a site audit and monitor your site health using SearchAtlas, sometimes our site crawlers get blocked by CDNs.
Content Delivery Networks (CDNs) are a group of servers that help deliver website content faster. If your website relies on a CDN to increase the performance of your website, then it’s possible the CDN’s firewall will block our crawler from accessing your site.
Resolving this issue is fairly straightforward and requires whitelisting the SearchAtlas site crawler. This post will explain how to do so on Cloudflare, as it is the most popular CDN provider for webmasters.
If you are using another CDN, the process is similar, and can still be done by following the steps outlined below.
SearchAtlas uses one primary IP address to monitor websites:
You will need to whitelist this IP address in order to run successful seo audits via SearchAtlas.
Follow these steps to proceed with whitelisting:
After performing the above steps, SearchAtlas will have access to your website for monitoring.
For help and a better understanding of Cloudflare’s IP Access Rules, see Cloudflare’s support documentation.
If you are still unable to successfully run a site audit, please contact our support team between 9am-6pm (PST), M-F, via the chat feature in your dashboard. Or, book a software demo with someone from our team.
“They are dedicated to our success and are a thoughtful sounding board when we run ideas by them - sometimes on ideas and projects that are tangential to our main SEO project with them. Also, I love that they allow for shorter-term contracts compared to the usual 1-year contract with other SEO companies. Lastly, they deliver on their promises.”
Enter your website URL and we’ll give you a personalized step-by-step action plan showing what exactly you need to do to get more traffic.
Get detailed recommendations for on-page, off-site, and technical optimizations.