Log In Sign Up

jcvignoli.com
robots.txt

Robots Exclusion Standard data for jcvignoli.com

Resource Scan

Scan Details

Site Domain jcvignoli.com
Base Domain jcvignoli.com
Scan Status Ok
Last Scan2025-12-31T08:16:28+00:00
Next Scan 2026-01-30T08:16:28+00:00

Last Scan

Scanned2025-12-31T08:16:28+00:00
URL https://jcvignoli.com/robots.txt
Redirect https://www.jcvignoli.com/robots.txt
Redirect Domain www.jcvignoli.com
Redirect Base jcvignoli.com
Domain IPs 185.125.27.16, 2001:1600:0:aaaa::80:d
Redirect IPs 185.125.27.16, 2001:1600:0:aaaa::80:d
Response IP 185.125.27.16
Found Yes
Hash 62e28faf7f96f85f5efc75414c4af86e94991524e0ebd4a83395e0fd4a1dcafd
SimHash bff61a14ee9b

Groups

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

siteauditbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

petalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.jcvignoli.com/sitemap.xml
sitemap https://www.jcvignoli.com/blog/sitemap.xml
sitemap https://www.jcvignoli.com/blog/sitemap-news.xml
sitemap https://www.jcvignoli.com/tonio/wp-sitemap.xml
sitemap https://www.jcvignoli.com/celestia/sitemap.xml
sitemap https://la-puerta-de-la-amazonia.jcvignoli.com/sitemap.xml
sitemap https://wikileaks.jcvignoli.com/sitemap.xml
Back to top

Comments

  • Too many requests... slowdown.
  • AhrefsBot http://ahrefs.com/robot/
  • SemrushBot https://www.semrush.com/bot/
  • Bingbot http://www.bing.com/bingbot.htm
  • Dont want Huawei AI, asks a lot
  • General
  • Blog
  • Tonio
  • Celestia
  • La Puerta
  • Wikileaks
Back to top