Log In Sign Up

animecons.ca
robots.txt

Robots Exclusion Standard data for animecons.ca

Resource Scan

Scan Details

Site Domain animecons.ca
Base Domain animecons.ca
Scan Status Ok
Last Scan2024-11-07T11:17:03+00:00
Next Scan 2024-11-14T11:17:03+00:00

Last Scan

Scanned2024-11-07T11:17:03+00:00
URL https://animecons.ca/robots.txt
Domain IPs 104.21.68.25, 172.67.185.119, 2606:4700:3030::6815:4419, 2606:4700:3033::ac43:b977
Response IP 104.21.68.25
Found Yes
Hash fead9e60632fec7a0087f8262ff55a66d02c350aa32d7012209cf2c528f7d318
SimHash c23c5123ea39

Groups

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

charlotte

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yeti

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

bytespider | byte spider | bytedance | bytedance

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

ias_wombles

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

moget

Rule Path
Disallow /

proximic

Rule Path
Disallow /

voyager

Rule Path
Disallow /

*

Rule Path
Disallow /advertising
Disallow /cgi-bin
Disallow /contact
Disallow /events/update/
Disallow /home/ads
Disallow /podcast
Disallow /store
Disallow /widgets
Disallow /x/px
Disallow /*.pdf$
Disallow /*.Pdf$
Disallow /*.PDF$
Disallow /*.zip$
Disallow /*.Zip$
Disallow /*.ZIP$
Disallow /members/history/searchcons.php

Other Records

Field Value
crawl-delay 1.5
Back to top

Other Records

Field Value
sitemap https://animecons.ca/sitemaps/sitemap-acca.xml
Back to top