dexform.com
robots.txt

Robots Exclusion Standard data for dexform.com

Resource Scan

Scan Details

Site Domain dexform.com
Base Domain dexform.com
Scan Status Ok
Last Scan4/16/2025, 6:05:23 AM
Next Scan 4/23/2025, 6:05:23 AM

Last Scan

Scanned4/16/2025, 6:05:23 AM
URL https://dexform.com/robots.txt
Redirect https://www.dexform.com/robots.txt
Redirect Domain www.dexform.com
Redirect Base dexform.com
Domain IPs 104.21.9.149, 172.67.160.49, 2606:4700:3034::6815:995, 2606:4700:3037::ac43:a031
Redirect IPs 104.21.9.149, 172.67.160.49, 2606:4700:3034::6815:995, 2606:4700:3037::ac43:a031
Response IP 172.67.160.49
Found Yes
Hash 4ecdd2a254992c74dff21376a1d60eacf4e0da7c6eba5b1cd3a7dcb461413b11
SimHash 6cd0d381c7b5

Groups

*

Rule Path
Disallow /

msnbot
bingbot
slurp
yahoo! slurp
duckduckbot
applebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

yandex

Rule Path
Disallow

Other Records

Field Value
crawl-delay 4

googlebot
mediapartners-google
adsbot-google
apis-google
adsbot-google-mobile

Rule Path
Disallow

Comments

  • __________
  • / ------ //
  • / ------ ///
  • / ------ ////
  • /________////
  • ==========//
  • ==========/ Dexform.com
  • >>>>>>>_______________________________________\`-._
  • >>>>>>> /.-'
  • Disallow all user agents
  • Rate limiting & settings for allowed user agents