브라우저가 최신 버전이 아닙니다. 사이트가 제대로 표시되지 않을 수 있습니다. 브라우저를 업데이트해 주세요.

지식 베이스
Semrush Toolkits
SEO Toolkit
On Page SEO Checker
Why did I get a “page is not accessible” note for some of my pages?

Why did I get a “page is not accessible” note for some of my pages?

Question

This message will appear if the On Page SEO Checker crawler was blocked or unable to crawl your page. Please check the robots.txt file on your website to make sure that is allows our user agents to crawl its pages.

If our bots are not blocked in robots.txt, to fix the issue you need to whitelist the following IP addresses and User-agent with your hosting and any plugins/services you may manage your site with (i.e Cloudflare, ModSecurity):

85.208.98.53
85.208.98.0/24
User-agent: SemrushBot-SI

To specify the Port, use one of the following options:

Port 80: HTTP
Port 443: HTTPS

Additionally, you should also whitelist the Site Audit IP which is used to crawl pages at the following IP address: 

46.229.173.67
46.229.173.66
46.229.173.68
85.208.98.128/25

User-agent name: SemrushBot-SA and SiteAuditBot

자주 묻는 질문
더 보기
최근 조회