Log In Sign Up

mareventofavignana.it
robots.txt

Robots Exclusion Standard data for mareventofavignana.it

Resource Scan

Scan Details

Site Domain mareventofavignana.it
Base Domain mareventofavignana.it
Scan Status Ok
Last Scan2025-10-18T01:32:30+00:00
Next Scan 2025-11-17T01:32:30+00:00

Last Scan

Scanned2025-10-18T01:32:30+00:00
URL https://mareventofavignana.it/robots.txt
Redirect https://www.mareventofavignana.it/robots.txt
Redirect Domain www.mareventofavignana.it
Redirect Base mareventofavignana.it
Domain IPs 104.21.32.51, 172.67.183.102, 2606:4700:3030::ac43:b766, 2606:4700:3031::6815:2033
Redirect IPs 104.21.32.51, 172.67.183.102, 2606:4700:3030::ac43:b766, 2606:4700:3031::6815:2033
Response IP 104.21.32.51
Found Yes
Hash 710947c391b308f1023188d35c3aa3b239f07fac0b45af042d6655d0b1028283
SimHash 2e24c8f7f1d1

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /?s=
Disallow /page/*/?s=
Disallow /search/
Disallow /agenzie/
Disallow /fix/
Disallow /utils/
Disallow /css/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/

googlebot
googlebot-image
googlebot-video
googlebot-mobile
adsbot-google
adsbot-google-mobile-app
mediapartners-google
google-read-aloud
feedfetcher-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

yandex

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 20

duckduckbotfbytespider

Rule Path
Allow /

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 15

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

gptbot
openai-gptcrawl
claude
perplexitybot
llamabot
gemini
bingbot-conversational

Rule Path
Allow /

Other Records

Field Value
crawl-delay 20
Back to top

Other Records

Field Value
sitemap https://www.mareventofavignana.it/sitemap_index.xml
Back to top

Comments

  • /\_/\
  • ( o.o ) Salvo / @Fibonacci
  • > ^ < I'm the original master of this craft - no need to imitate.
  • ___________________ . , ; .
  • (___________________|~~~~~X.;' .
  • ' `" ' `
  • -----------------------------------------------------
  • I play clean - but lethal.
  • White-hat, always. Because real mastery doesn't need shortcuts.
  • I don't game the system. I *understand* it deeper than most ever will.
  • No tricks. No fluff. Just precision, insight, and domination.
  • I walk alone. But I leave a trail that shakes rankings.
  • They watch. They try.
  • But no one can fight me.
  • -----------------------------------------------------
  • SITEMAP
  • -----------------------------------------------------
  • -----------------------------------------------------
  • CRAWLER WILDCARD
  • -----------------------------------------------------
  • -----------------------------------------------------
  • MAIN CRAWLER
  • -----------------------------------------------------
  • Googlebot
  • Bingbot
  • Yandex
  • Baiduspider
  • DuckDuckBot
  • Slurp (Yahoo)
  • applebot
  • -----------------------------------------------------
  • AI CRAWLERS
  • -----------------------------------------------------
Back to top