v-airport.com
robots.txt

Robots Exclusion Standard data for v-airport.com

Resource Scan

Scan Details

Site Domain v-airport.com
Base Domain v-airport.com
Scan Status Ok
Last Scan2024-06-25T21:45:44+00:00
Next Scan 2024-07-02T21:45:44+00:00

Last Scan

Scanned2024-06-25T21:45:44+00:00
URL https://v-airport.com/robots.txt
Domain IPs 104.21.83.73, 172.67.217.136, 2606:4700:3031::ac43:d988, 2606:4700:3037::6815:5349
Response IP 104.21.83.73
Found Yes
Hash 6bf5baec6a193e1c61f8b53cc36556a6b22e35b2b773f5d7c63f71c288421461
SimHash 6f18c951d6a2

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/cache
Disallow /wp-content/cache
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /webstat/
Disallow /xmlrpc.php
Disallow /page/
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow /*?replytocom
Disallow */attachment/*
Disallow /*?utm_source*
Disallow /feed/
Disallow */*/feed/*/
Disallow */feed
Disallow */*/feed
Disallow /?feed=
Disallow */comments
Disallow /comments/
Disallow */comments/
Disallow */comment-page-*
Disallow /*?*
Disallow /*?
Disallow /?
Disallow /?s=
Disallow /.well-known/
Disallow /apple-app-site-association
Disallow /wp-content/uploads/db-backup/
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow /*.js*
Allow /*.css*
Allow /*.png
Allow /*.jpg

Other Records

Field Value
crawl-delay 10

googlebot-image

Rule Path
Disallow
Allow /*

mozilla/5.0 (compatible; ezooms/1.0; ezooms.bot@gmail.com)

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

httrack

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

webchatgpt

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

news-please

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

peer39_crawler/1.0

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

https://hada.news

Rule Path
Disallow /

https://www.imediaethics.org

Rule Path
Disallow /

jenkersbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

youbot

Rule Path
Disallow /

mojeek

Rule Path
Disallow /

yandex

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /cgi-bin
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /webstat/
Disallow /xmlrpc.php
Disallow /tag/
Disallow /author/
Disallow /page/
Disallow */page/
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow /*?replytocom
Disallow */attachment/*
Disallow /*?utm_source*
Disallow /feed/
Disallow */*/feed/*/
Disallow */feed
Disallow */*/feed
Disallow /?feed=
Disallow */comments
Disallow /comments/
Disallow */comments/
Disallow */comment-page-*
Disallow /*?*
Disallow /*?
Disallow /?
Disallow /?s=
Disallow /map
Disallow /panorama
Disallow /wp-content/uploads/db-backup/
Allow /*.js*
Allow /*.css*
Allow /*.png
Allow /*.jpg

Other Records

Field Value
crawl-delay 10

yandeximages

Rule Path
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://v-airport.com/sitemap.xml
sitemap https://v-airport.com/sitemap.xml

Warnings

  • `host` is not a known field.