stopstalk.com
robots.txt

Robots Exclusion Standard data for stopstalk.com

Resource Scan

Scan Details

Site Domain stopstalk.com
Base Domain stopstalk.com
Scan Status Ok
Last Scan2025-06-12T03:05:06+00:00
Next Scan 2025-07-12T03:05:06+00:00

Last Scan

Scanned2025-06-12T03:05:06+00:00
URL https://stopstalk.com/robots.txt
Redirect https://www.stopstalk.com/robots.txt
Redirect Domain www.stopstalk.com
Redirect Base stopstalk.com
Domain IPs 104.21.80.16, 172.67.173.16, 2606:4700:3033::6815:5010, 2606:4700:3036::ac43:ad10
Redirect IPs 104.21.80.16, 172.67.173.16, 2606:4700:3033::6815:5010, 2606:4700:3036::ac43:ad10
Response IP 172.67.173.16
Found Yes
Hash 0e47c733c67baf99dd4fb7285a3421a95604fbb3363550dd762bc14a044c8a5b
SimHash f619c4f2cb93

Groups

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

*

Rule Path
Disallow /static/scripts/
Disallow /static/images/gifs/
Disallow /static/svg/
Disallow /support_us
Disallow /xmlrpc.php
Disallow /appadmin
Disallow /static/js/*.js
Disallow /static/css/*.css
Disallow /*.json*

Other Records

Field Value
crawl-delay 20

Comments

  • Baiduspider
  • Yandex