Getting Started
How-To Articles
SEMrush Toolkits
SEO Toolkit
Billing and Account
API
Contact Us
Quick Links
SEOquake
Domain Overview
Traffic Analytics
Organic Research
Keyword Gap
Backlink Gap
Keyword Overview
Keyword Magic Tool
Keyword Difficulty Tool
Organic Traffic Insights
Backlink Analytics
Backlink Audit
Link Building Tool
Bulk Backlink Analysis
Position Tracking
SEMrush Sensor
Site Audit
On Page SEO Checker
Log File Analyzer
Listing Management
SEMrush Rank
Advertising Toolkit
Social Media Toolkit
Content Marketing Toolkit
Competitive Research Toolkit
Management Toolkit
Recently viewed
Why did I get a “page is not accessible” note for some of my pages? Question
This message will appear if the On Page SEO Checker crawler was blocked or unable to crawl your page. To fix this issue, refer to the robots.txt file on your website to make sure that is allows user agents to crawl its pages.
The name of our robot to whitelist is SemrushBot-SI. To whitelist our crawler, please whitelist the following IP Addresses:
213.174.147.83
192.243.56.76
To specify the Port, use one of the following options:
Port 80: HTTP
Port 443: HTTPS
Additionally, you should also whitelist the Site Audit IP which is used to crawl pages at the following IP address: 46.229.173.67
Was this article helpful?
Frequently asked questions
-
Why did I get a “page is not accessible” note for some of my pages?