arnaqueinternet.com
robots.txt

Robots Exclusion Standard data for arnaqueinternet.com

Resource Scan

Scan Details

Site Domain arnaqueinternet.com
Base Domain arnaqueinternet.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-07T22:21:19+00:00
Next Scan 2024-10-07T22:21:19+00:00

Last Successful Scan

Scanned2024-08-09T22:20:20+00:00
URL https://arnaqueinternet.com/robots.txt
Domain IPs 191.101.228.4, 2a02:4780:84:82cf:b464:403d:94c:21ca
Response IP 93.127.187.61
Found Yes
Hash 0b22b73e013e0fe7f89ec43caac25f86411806ae5e9052078caaa0967beaa39a
SimHash 490009842391

Groups

*

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/
Disallow /readme.html
Disallow /refer/

Other Records

Field Value
sitemap https://arnaqueinternet.com/post-sitemap.xml
sitemap https://arnaqueinternet.com/page-sitemap.xml
sitemap https://arnaqueinternet.com/category-sitemap.xml
sitemap https://arnaqueinternet.com/post_tag-sitemap.xml