baic-auto.pl
robots.txt

Robots Exclusion Standard data for baic-auto.pl

Resource Scan

Scan Details

Site Domain baic-auto.pl
Base Domain baic-auto.pl
Scan Status Ok
Last Scan2024-10-07T00:47:59+00:00
Next Scan 2024-11-06T00:47:59+00:00

Last Scan

Scanned2024-10-07T00:47:59+00:00
URL https://baic-auto.pl/robots.txt
Domain IPs 195.78.66.169
Response IP 195.78.66.169
Found Yes
Hash 32b958d1973c38b04c6180c36ac7b7e740ae6af8c1e0f2230f0cd55a96554c85
SimHash 4e3c5410ce71

Groups

*

Rule Path
Disallow /about/
Disallow /adx/
Disallow /captcha/
Disallow /cgi-bin/
Disallow /cookie/
Disallow /embed/
Disallow /folder/
Disallow /include/
Disallow /index.php/
Disallow /login/
Disallow /media/
Disallow /null
Disallow /undefined
Disallow /api.php
Disallow /cron.php
Disallow /get.php
Disallow /cron.sh
Disallow /error_log
Disallow /install.php
Disallow /purposes.json

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

twengabot/2.0

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

Other Records

Field Value
sitemap https://baic-auto.pl/sitemap.xml

Comments

  • Automatically banned scanners and crawlers section

Warnings

  • 2 invalid lines.