dmvcheatsheets.com
robots.txt

Robots Exclusion Standard data for dmvcheatsheets.com

Resource Scan

Scan Details

Site Domain dmvcheatsheets.com
Base Domain dmvcheatsheets.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-20T17:53:37+00:00
Next Scan 2024-06-27T17:53:37+00:00

Last Successful Scan

Scanned2024-04-10T17:51:18+00:00
URL https://dmvcheatsheets.com/robots.txt
Redirect https://www.dmvcheatsheets.com/robots.txt
Redirect Domain www.dmvcheatsheets.com
Redirect Base dmvcheatsheets.com
Domain IPs 104.26.2.59, 104.26.3.59, 172.67.71.96, 2606:4700:20::681a:23b, 2606:4700:20::681a:33b, 2606:4700:20::ac43:4760
Redirect IPs 104.26.2.59, 104.26.3.59, 172.67.71.96, 2606:4700:20::681a:23b, 2606:4700:20::681a:33b, 2606:4700:20::ac43:4760
Response IP 104.26.3.59
Found Yes
Hash d57064f4439cbde200426267ecf2349c403e1b1d226aa79e17d5708349303910
SimHash 885d5b05cd51

Groups

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /orders/
Disallow /users/
Disallow /questions/
Disallow /register
Disallow /exams/*/products/*/practice_tests/*/questions/*

femtosearchbot

Rule Path
Disallow *

Other Records

Field Value
sitemap https://www.dmvcheatsheets.com/sitemap.xml.gz

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file