newspapers.directory
robots.txt

Robots Exclusion Standard data for newspapers.directory

Resource Scan

Scan Details

Site Domain newspapers.directory
Base Domain newspapers.directory
Scan Status Ok
Last Scan2025-11-23T06:57:59+00:00
Next Scan 2025-11-30T06:57:59+00:00

Last Scan

Scanned2025-11-23T06:57:59+00:00
URL https://newspapers.directory/robots.txt
Domain IPs 104.21.79.27, 172.67.140.235, 2606:4700:3030::ac43:8ceb, 2606:4700:3032::6815:4f1b
Response IP 104.21.79.27
Found Yes
Hash fa8666d0adcf2d275fb7258d8a947baddeb999c0e702958f2a4b574b4f57c891
SimHash 2280ad860c72

Groups

*

Rule Path
Disallow

Other Records

Field Value
sitemap http://www.newspapers.directory/sitemap.xml

Comments

  • /robots.txt file for http://www.newspapers.directory/
  • Author: Newspapers.directory