clasies.com
robots.txt

Robots Exclusion Standard data for clasies.com

Resource Scan

Scan Details

Site Domain clasies.com
Base Domain clasies.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-01T01:03:22+00:00
Next Scan 2026-03-01T01:03:22+00:00

Last Successful Scan

Scanned2025-02-23T13:26:17+00:00
URL https://clasies.com/robots.txt
Redirect https://www.clasies.com/robots.txt
Redirect Domain www.clasies.com
Redirect Base clasies.com
Domain IPs 104.21.33.170, 172.67.165.11, 2606:4700:3031::ac43:a50b, 2606:4700:3033::6815:21aa
Redirect IPs 104.21.33.170, 172.67.165.11, 2606:4700:3031::ac43:a50b, 2606:4700:3033::6815:21aa
Response IP 172.67.165.11
Found Yes
Hash 77ae0a1647bef26a10b12b4d3e7fc6909195b47ce0db4072e2db2d41aaee12ca
SimHash 501de8e1c680

Groups

googlebot

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

adsbot-google

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

googlebot-image

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Disallow /comments/qualify/*

*

Rule Path
Disallow /admin/
Disallow /u/*
Disallow /nf/*
Disallow /favicon.ico
Disallow /.htaccess
Disallow /*.json
Disallow /ads/get_phone/*
Disallow /javascript%3Avoid%280%29
Disallow /item/add_comment/*
Disallow /ajax/*
Disallow /ads/favorite_add/*
Disallow /users/myevisos_by_mail
Disallow /ads/view_info
Disallow /ads/view_info/*
Disallow /1010550/*
Disallow /1379743294/*
Disallow /users/set_rating/*
Disallow /users_contacts/send/*
Disallow /latest-posts-v2
Disallow /ads_images/get_images/
Disallow /item/locate_in_map/*
Allow /ajax/static_blocks

petalbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yadirectbot

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

w3c-checklink

Rule Path
Disallow /

badbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

bdcbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

applebot

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

seekportbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

voilabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

amazonbot
anthropic-ai
applebot-extended
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
dataforseobot
facebookbot
google-extended
gptbot
imagesiftbot
magpie-crawler
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
youbot

Rule Path
Disallow /

Comments

  • User-agent: MJ12bot
  • disallow: /
  • User-agent: ia_archiver
  • Disallow: /