needgreatwork.com
robots.txt

Robots Exclusion Standard data for needgreatwork.com

Resource Scan

Scan Details

Site Domain needgreatwork.com
Base Domain needgreatwork.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-26T03:46:21+00:00
Next Scan 2025-01-24T03:46:21+00:00

Last Successful Scan

Scanned2023-04-05T08:05:42+00:00
URL https://needgreatwork.com/robots.txt
Domain IPs 13.250.129.152, 2406:da18:9d0:143e:8e74:1b1a:98b9:2813, 2406:da18:9d0:143f:29e7:ae24:cfea:e9bb, 54.151.156.30
Response IP 54.151.156.30
Found Yes
Hash b4619263070d77906f5d3d7ec6be01baff1ee4986aade801d114f19b3b065031
SimHash 4300dc100f92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://needgreatwork.com/sitemap.xml