allnews.ng
robots.txt

Robots Exclusion Standard data for allnews.ng

Resource Scan

Scan Details

Site Domain allnews.ng
Base Domain allnews.ng
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan1/22/2025, 11:32:32 AM
Next Scan 4/22/2025, 11:32:32 AM

Last Successful Scan

Scanned9/25/2024, 11:31:03 AM
URL https://allnews.ng/robots.txt
Domain IPs 172.66.40.227, 172.66.43.29, 2606:4700:3108::ac42:28e3, 2606:4700:3108::ac42:2b1d
Response IP 172.66.40.227
Found Yes
Hash 78d5d2a2b34290eb78be224fb5c3b2de42d5a1a2cd39705d28869d3f764a2161
SimHash 650d1044e3f1

Groups

*

Rule Path
Disallow

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://allnews.ng/sitemap.xml