sweeps.pet
robots.txt

Robots Exclusion Standard data for sweeps.pet

Resource Scan

Scan Details

Site Domain sweeps.pet
Base Domain sweeps.pet
Scan Status Ok
Last Scan2024-06-03T01:02:19+00:00
Next Scan 2024-06-10T01:02:19+00:00

Last Scan

Scanned2024-06-03T01:02:19+00:00
URL https://sweeps.pet/robots.txt
Domain IPs 104.18.43.37, 172.64.144.219, 2606:4700:4400::6812:2b25, 2606:4700:4400::ac40:90db
Response IP 104.18.43.37
Found Yes
Hash 9d4679e54ce2b924639f783bfead330265c22c523408c1fce6d8e01e3180392c
SimHash e90088008bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://sweeps.pet/sitemap.xml
sitemap https://sweeps.pet/sitemap.rss