Log In Sign Up

pianetamamma.it
robots.txt

Robots Exclusion Standard data for pianetamamma.it

Resource Scan

Scan Details

Site Domain pianetamamma.it
Base Domain pianetamamma.it
Scan Status Ok
Last Scan2024-09-20T12:03:05+00:00
Next Scan 2024-09-27T12:03:05+00:00

Last Scan

Scanned2024-09-20T12:03:05+00:00
URL https://pianetamamma.it/robots.txt
Redirect https://www.pianetamamma.it/robots.txt
Redirect Domain www.pianetamamma.it
Redirect Base pianetamamma.it
Domain IPs 176.34.239.234, 34.248.24.67
Redirect IPs 23.50.90.17, 2600:1413:b000:68d::3198, 2600:1413:b000:698::3198
Response IP 104.69.46.165
Found Yes
Hash 7a0376a7fe20b76bf8d0b682434ed894c64fc018719688615a97839edea46911
SimHash 0554ff20ed83

Groups

*

Rule Path
Disallow /cerca/
Disallow /gallery/
Disallow /wp-content/

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

seekr

Rule Path
Disallow /

meltwater

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.pianetamamma.it/sitemap/sitemap_item_pianetamamma.xml
Back to top

Comments

  • Robots.txt - pianetamamma.it
  • Blocco crawler BOT
  • 2016.10.25 by Vinci
Back to top

Warnings

  • 2 invalid lines.
Back to top