cheeseitup.timesfoodie.com
robots.txt

Robots Exclusion Standard data for cheeseitup.timesfoodie.com

Resource Scan

Scan Details

Site Domain cheeseitup.timesfoodie.com
Base Domain timesfoodie.com
Scan Status Ok
Last Scan2024-11-18T23:03:41+00:00
Next Scan 2024-11-25T23:03:41+00:00

Last Scan

Scanned2024-11-18T23:03:41+00:00
URL https://cheeseitup.timesfoodie.com/robots.txt
Domain IPs 184.50.85.153, 184.50.85.185, 2600:1413:b000:1c::17d1:2ed9, 2600:1413:b000:1c::17d1:2ee2
Response IP 184.50.85.185
Found Yes
Hash 10c037b2a78b14bdfbea8864f9f29bd0fdc419939aeeb0fcf6f677ae70ba0465
SimHash 1c15db50e039

Groups

*

Rule Path
Disallow /test-section/
Disallow /embed/
Disallow /search-result/

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow

dataforseobot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

Comments

  • Baiduspider
  • Yandex
  • Facebook