newtoncountynews.net
robots.txt

Robots Exclusion Standard data for newtoncountynews.net

Resource Scan

Scan Details

Site Domain newtoncountynews.net
Base Domain newtoncountynews.net
Scan Status Ok
Last Scan2024-05-17T03:24:29+00:00
Next Scan 2024-05-24T03:24:29+00:00

Last Scan

Scanned2024-05-17T03:24:29+00:00
URL https://newtoncountynews.net/robots.txt
Domain IPs 138.197.40.131
Response IP 138.197.40.131
Found Yes
Hash a70679363dd519abf5bae82de1e96f3c1f6c47bb07cf7bd8976499ad25c08c17
SimHash 6879fb05f7d3

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

slurp

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://newtoncountynews.net/sitemap.xml