biographiesofactors.com
robots.txt

Robots Exclusion Standard data for biographiesofactors.com

Resource Scan

Scan Details

Site Domain biographiesofactors.com
Base Domain biographiesofactors.com
Scan Status Ok
Last Scan2024-09-21T13:22:11+00:00
Next Scan 2024-09-28T13:22:11+00:00

Last Scan

Scanned2024-09-21T13:22:11+00:00
URL https://biographiesofactors.com/robots.txt
Domain IPs 104.21.38.205, 172.67.138.83, 2606:4700:3030::ac43:8a53, 2606:4700:3033::6815:26cd
Response IP 172.67.138.83
Found Yes
Hash 6352219ecbf3b1077c58804f077649d59b320f60f59ed3963ef2bacd3974e158
SimHash 6111e570cf91

Groups

*

Rule Path
Disallow /engine/
Disallow /user/
Disallow /newposts/
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /tags/
Disallow /language/
Disallow /templates/
Disallow /upgrade/
Disallow /newposts/
Disallow /index.php
Disallow /statistics.html
Disallow /addnews.html
Disallow /admin.php
Disallow /*print
Disallow /*page/
Disallow /cdn-cgi/
Allow /templates/biographies/*.css
Allow /templates/biographies/*.js
Allow /templates/biographies/*.jpg
Allow /templates/biographies/*.jpeg
Allow /templates/biographies/*.png
Allow /templates/biographies/*.ico

Other Records

Field Value
sitemap https://biographiesofactors.com/sitemap.xml

Warnings

  • `host` is not a known field.