Log In Sign Up

anumber1air.com
robots.txt

Robots Exclusion Standard data for anumber1air.com

Resource Scan

Scan Details

Site Domain anumber1air.com
Base Domain anumber1air.com
Scan Status Ok
Last Scan2025-07-18T22:12:02+00:00
Next Scan 2025-08-17T22:12:02+00:00

Last Scan

Scanned2025-07-18T22:12:02+00:00
URL https://anumber1air.com/robots.txt
Domain IPs 141.193.213.20, 141.193.213.21
Response IP 141.193.213.20
Found Yes
Hash be189cdf18b944ef20108a560915027afddbac57880d12706dca1c414c9dfa25
SimHash 76b75845c6ba

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /trackback/
Disallow /cgi-bin/
Disallow /xmlrpc.php
Disallow /wp-json/
Disallow /*?s=
Disallow /?s=*
Disallow /search/
Disallow /*?attachment_id=*
Disallow /*.php$
Disallow /author/
Allow /wp-content/uploads/
Disallow /?rest_route=
Disallow /comments/feed/
Disallow /wp-login.php
Disallow /wp-signup.php

googlebot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/

adsbot-google

Rule Path
Allow /
Disallow /wp-admin/

bingbot

Rule Path
Allow /wp-content/uploads/
Disallow /wp-admin/

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

sogou

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

ai-powered-bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

seekport

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

rankactivelinkbot

Rule Path
Disallow /

ranksonicbot

Rule Path
Disallow /

memorybot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

bubing

Rule Path
Disallow /

proximic

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

aspseek

Rule Path
Disallow /

docomo

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

addthis

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

advbot

Rule Path
Disallow /

ai-hitbot

Rule Path
Disallow /

synthesiobot

Rule Path
Disallow /

zmagsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

kraken

Rule Path
Disallow /

spidereye

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

opensitebot

Rule Path
Disallow /

paperbot

Rule Path
Disallow /

pimonbot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

nekstbot

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

pycurl

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

zgrab

Rule Path
Disallow /

wget

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

httrack

Rule Path
Disallow /

urlgrabber

Rule Path
Disallow /

http_request2

Rule Path
Disallow /

winhttp

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

java/1.8.0

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

curl

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

go-http-client/1.1

Rule Path
Disallow /

okhttp

Rule Path
Disallow /

ruby

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

apache-httpclient

Rule Path
Disallow /

postmanruntime

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

awariobot

Rule Path
Disallow /
Disallow /*?utm_source=
Disallow /*?utm_medium=
Disallow /*?utm_campaign=
Disallow /*?utm_content=
Disallow /*?gclid=

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://anumber1air.com/sitemap.xml
Back to top

Comments

  • Allow important directories for indexing
  • Sitemap
  • Prevent spam bots from abusing search and admin pages
  • Optimize for Google bots
  • Optimize for AdsBot-Google
  • Bingbot optimization
  • Block known spam and irrelevant bots
  • Prevent parameter crawling
  • Crawler delay for non-essential bots
Back to top

Warnings

  • 2 invalid lines.
Back to top