ygselectth.com
robots.txt

Robots Exclusion Standard data for ygselectth.com

Resource Scan

Scan Details

Site Domain ygselectth.com
Base Domain ygselectth.com
Scan Status Ok
Last Scan2024-08-24T10:25:10+00:00
Next Scan 2024-09-23T10:25:10+00:00

Last Scan

Scanned2024-08-24T10:25:10+00:00
URL https://ygselectth.com/robots.txt
Redirect https://www.ygselectth.com/robots.txt
Redirect Domain www.ygselectth.com
Redirect Base ygselectth.com
Domain IPs 104.21.39.114, 172.67.144.224, 2606:4700:3031::6815:2772, 2606:4700:3037::ac43:90e0
Redirect IPs 104.21.39.114, 172.67.144.224, 2606:4700:3031::6815:2772, 2606:4700:3037::ac43:90e0
Response IP 104.21.39.114
Found Yes
Hash a598488eea1e6b928897943576d40e809d0ccbc7df043797545a56b09b5923c0
SimHash 1960882cea29

Groups

*

Rule Path
Disallow */ajax*
Disallow */ipn*
Disallow */mpay*
Disallow */payment_callback*
Disallow */payment-callback*
Disallow */test*
Disallow */third_party*
Disallow */third-party*
Disallow */redis*
Disallow */cart*
Disallow */fake*

Comments

  • robotstxt.org/