aagvgubreakingnews.co.za
robots.txt

Robots Exclusion Standard data for aagvgubreakingnews.co.za

Resource Scan

Scan Details

Site Domain aagvgubreakingnews.co.za
Base Domain aagvgubreakingnews.co.za
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-07-23T03:43:24+00:00
Next Scan 2024-10-21T03:43:24+00:00

Last Successful Scan

Scanned2022-12-28T13:35:22+00:00
URL https://aagvgubreakingnews.co.za/robots.txt
Domain IPs 18.140.162.93, 52.220.170.182
Response IP 18.140.162.93
Found Yes
Hash d5558081547207fbdb84dab5acb450c8ecb766d6ef289745b860cdf5286e9adb
SimHash 6518d454e311

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 300