alobus.com
robots.txt

Robots Exclusion Standard data for alobus.com

Resource Scan

Scan Details

Site Domain alobus.com
Base Domain alobus.com
Scan Status Ok
Last Scan2026-01-12T05:44:54+00:00
Next Scan 2026-01-19T05:44:54+00:00

Last Scan

Scanned2026-01-12T05:44:54+00:00
URL https://alobus.com/robots.txt
Domain IPs 45.252.249.44
Response IP 45.252.249.44
Found Yes
Hash 7367da83f21cb70bbd9ffc7046fa855bbf11c63b01dbfc94db17caddfe24a072
SimHash 6a5ec9506ad8

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /readme.html
Disallow /license.txt
Disallow /xmlrpc.php
Disallow /trackback/
Disallow /apple-app-site-association
Disallow /*.woff2$
Disallow /.well-known/apple-app-site-association
Disallow /search/
Disallow /author/
Disallow */author/
Disallow /*?amp=1
Disallow */amp/
Disallow */page/
Disallow /page/
Disallow /*?nonamp=1*
Disallow /*?s=*
Disallow /*utm_source%3D
Disallow /*utm_medium%3D
Disallow /*utm_campaign%3D
Disallow /*.php$
Disallow /*.pdf$
Disallow /*.doc$
Disallow /*.xls$
Disallow /*/feed/
Disallow /feed/
Disallow /category/feed/
Disallow /tag/feed/
Disallow /wp-json/
Disallow /?rest_route=*
Disallow /firebase-messaging-sw
Disallow /*?customize_changeset_uuid=
Disallow /*?customize_changeset_uuid=*
Disallow /?customize_changeset_uuid=

teleport

Rule Path
Disallow /

httrack

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

webzip

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sistrixbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

downthemall

Rule Path
Disallow /

wget

Rule Path
Disallow /

curl

Rule Path
Disallow /

fget

Rule Path
Disallow /

httpclient

Rule Path
Disallow /

badbot

Rule Path
Disallow /

spambot

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

pagepeeker

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://alobus.com/sitemap_index.xml

Comments

  • sitemap