9and10news.com
robots.txt

Robots Exclusion Standard data for 9and10news.com

Resource Scan

Scan Details

Site Domain 9and10news.com
Base Domain 9and10news.com
Scan Status Ok
Last Scan2024-05-15T08:56:17+00:00
Next Scan 2024-05-22T08:56:17+00:00

Last Scan

Scanned2024-05-15T08:56:17+00:00
URL https://9and10news.com/robots.txt
Redirect https://www.9and10news.com:443/robots.txt
Redirect Domain www.9and10news.com
Redirect Base 9and10news.com
Domain IPs 15.197.164.230, 3.33.179.4
Redirect IPs 23.49.60.135, 23.49.60.136, 2600:1413:b000:14::b857:c145, 2600:1413:b000:14::b857:c160
Response IP 42.99.140.219
Found Yes
Hash 548521349c0f8f5a16d87413427e84620febc411ae3ebc8dec3986a2306d7a94
SimHash 09d88cc3c6b3

Groups

*

Rule Path
Allow /

newsbreak

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

Other Records

Field Value
sitemap https://www.9and10news.com/arc/outboundfeeds/sitemap-index/?outputType=xml
sitemap https://www.9and10news.com/arc/outboundfeeds/sitemap-news-index/?outputType=xml
sitemap https://www.9and10news.com/arc/outboundfeeds/sitemap-section-index/?outputType=xml