arbitragehub.app
robots.txt

Robots Exclusion Standard data for arbitragehub.app

Resource Scan

Scan Details

Site Domain arbitragehub.app
Base Domain arbitragehub.app
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-05-03T10:36:12+00:00
Next Scan 2025-08-01T10:36:12+00:00

Last Successful Scan

Scanned2024-03-17T09:30:59+00:00
URL https://arbitragehub.app/robots.txt
Domain IPs 104.21.38.56, 172.67.219.136, 2606:4700:3032::6815:2638, 2606:4700:3035::ac43:db88
Response IP 172.67.219.136
Found Yes
Hash a759c7203ed22e2ca1d8fe8b4a82270ffb40245e1ad531478fdc95a52a2d2a4b
SimHash 61010840cfb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://arbitragehub.app/wp-sitemap.xml