z-p4.www.instagram.com
robots.txt
Robots Exclusion Standard data for z-p4.www.instagram.com
Resource Scan
Scan Details
Site Domain | z-p4.www.instagram.com |
Base Domain | instagram.com |
Scan Status | Ok |
Last Scan | 2024-11-12T06:57:45+00:00 |
Next Scan | 2024-11-26T06:57:45+00:00 |
Last Scan
Scanned | 2024-11-12T06:57:45+00:00 |
URL | https://z-p4.www.instagram.com/robots.txt |
Redirect | https://www.instagram.com/robots.txt |
Redirect Domain | www.instagram.com |
Redirect Base | instagram.com |
Domain IPs | 157.240.235.167, 2a03:2880:f34b:c3:face:b00c:0:6200 |
Redirect IPs | 2a03:2880:f20c:3e6:face:b00c:0:4420, 57.144.150.34 |
Response IP | 57.144.150.34 |
Found | Yes |
Hash | 47ec205ae8252fa7cb2d02a6b3f26a64fbec7e3dc0e7c01fc60145fbff38658b |
SimHash | f854d1014797 |
Groups
applebot
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
bingbot
Rule | Path |
---|---|
Disallow | /*/c/ |
Disallow | /*/comments/ |
Disallow | /*/liked_by/ |
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
discordbot
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
duckduckbot
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
facebookexternalhit
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
googlebot
Rule | Path |
---|---|
Disallow | /*/c/ |
Disallow | /*/comments/ |
Disallow | /*/liked_by/ |
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
googlebot-image
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
googlebot-video
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
googlebot-news
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
google-inspectiontool
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
linkedinbot
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
msnbot
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
naverbot
Rule | Path |
---|---|
Disallow | /*/c/ |
Disallow | /*/comments/ |
Disallow | /*/liked_by/ |
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
pinterestbot
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
screaming frog seo spider
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
seznambot
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
slurp
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
teoma
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
telegrambot
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
twitterbot
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
yeti
Rule | Path |
---|---|
Disallow | /accounts/login/*?next= |
Disallow | /ajax/ |
Disallow | /client_error/ |
Disallow | /direct/ |
Disallow | /logging/ |
Disallow | /publicapi/ |
Disallow | /qp/batch_fetch_web/ |
Disallow | /query/ |
*
Rule | Path |
---|---|
Disallow | / |
Comments