mysterious-dev.com
robots.txt

Robots Exclusion Standard data for mysterious-dev.com

Resource Scan

Scan Details

Site Domain mysterious-dev.com
Base Domain mysterious-dev.com
Scan Status Ok
Last Scan2024-06-04T23:31:49+00:00
Next Scan 2024-06-11T23:31:49+00:00

Last Scan

Scanned2024-06-04T23:31:49+00:00
URL https://www.mysterious-dev.com/robots.txt
Domain IPs 104.21.9.33, 172.67.141.106, 2606:4700:3032::6815:921, 2606:4700:3032::ac43:8d6a
Response IP 104.21.9.33
Found Yes
Hash 51e47010b4dd2cf17b167c3dbfa1930a81098c4225178d29722f3a1916e2527e
SimHash 6b449b504513

Groups

mediapartners-google
*

Rule Path
Disallow /search
Allow /
Allow /ads.txt

Other Records

Field Value
sitemap https://www.mysterious-dev.com/atom.xml?redirect=false&start-index=1&max-results=500