aura-international.org
robots.txt

Robots Exclusion Standard data for aura-international.org

Resource Scan

Scan Details

Site Domain aura-international.org
Base Domain aura-international.org
Scan Status Ok
Last Scan2024-09-18T07:43:54+00:00
Next Scan 2024-10-18T07:43:54+00:00

Last Scan

Scanned2024-09-18T07:43:54+00:00
URL https://aura-international.org/robots.txt
Redirect https://www.aura-international.org/robots.txt
Redirect Domain www.aura-international.org
Redirect Base aura-international.org
Domain IPs 3.7.61.18
Redirect IPs 3.7.61.18
Response IP 3.7.61.18
Found Yes
Hash c885587774995d285d5e0fe6d90a28815688a6b5d29604bb32bf703254362106
SimHash 24145a825515

Groups

*

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Allow /
Disallow /admin/
Disallow /24.01.01/
Disallow /_app_data/*.css
Disallow /_app_data/*.js
Disallow /_app_data/*.tpl
Disallow /plug/
Disallow /Service.asmx/

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /
Disallow /admin/
Disallow /24.01.01/
Disallow /_app_data/*.css
Disallow /_app_data/*.js
Disallow /_app_data/*.tpl
Disallow /plug/
Disallow /Service.asmx/

Other Records

Field Value
crawl-delay 10

googlebot-mobile

Rule Path
Allow /
Disallow /admin/
Disallow /24.01.01/
Disallow /_app_data/*.css
Disallow /_app_data/*.js
Disallow /_app_data/*.tpl
Disallow /plug/
Disallow /Service.asmx/

Other Records

Field Value
crawl-delay 10

googlebot-image

Rule Path
Allow /
Disallow /admin/
Disallow /24.01.01/
Disallow /_app_data/*.css
Disallow /_app_data/*.js
Disallow /_app_data/*.tpl
Disallow /plug/
Disallow /Service.asmx/

Other Records

Field Value
crawl-delay 10

adsbot-google

Rule Path
Allow /
Disallow /admin/
Disallow /24.01.01/
Disallow /_app_data/*.css
Disallow /_app_data/*.js
Disallow /_app_data/*.tpl
Disallow /plug/
Disallow /Service.asmx/

Other Records

Field Value
crawl-delay 10

facebot
baiduspider
duckduckbot
ia_archiver
ahrefsbot
semrushbot
mediapartners-google
ninjabot
msnbot-media
twiceler
gigabot
scrubby
asterias
yahoo-blogs
yandex
msnbot
slurp
teoma
gigabot
robozilla
nutch
naverbot
yeti
yahoo-mmcrawler
psbot
yahoo-blogs/v3.9
applebot
bingpreview

Rule Path
Disallow /