whatshouldireadnext.com
robots.txt

Robots Exclusion Standard data for whatshouldireadnext.com

Resource Scan

Scan Details

Site Domain whatshouldireadnext.com
Base Domain whatshouldireadnext.com
Scan Status Ok
Last Scan2024-11-14T21:32:05+00:00
Next Scan 2024-11-21T21:32:05+00:00

Last Scan

Scanned2024-11-14T21:32:05+00:00
URL https://whatshouldireadnext.com/robots.txt
Redirect https://www.whatshouldireadnext.com/robots.txt
Redirect Domain www.whatshouldireadnext.com
Redirect Base whatshouldireadnext.com
Domain IPs 104.21.17.115, 172.67.175.199, 2606:4700:3032::6815:1173, 2606:4700:3032::ac43:afc7
Redirect IPs 104.21.17.115, 172.67.175.199, 2606:4700:3032::6815:1173, 2606:4700:3032::ac43:afc7
Response IP 104.21.17.115
Found Yes
Hash 69f872d74a95c4c0d7e0f42147c6539887fcfa7b31d317633162513fb0ecad8c
SimHash aa1d1887ff73

Groups

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /subject/

Other Records

Field Value
sitemap https://whatshouldireadnext.com/sitemaps/sitemap.xml.gz

Comments

  • See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file