taf.by
robots.txt

Robots Exclusion Standard data for taf.by

Resource Scan

Scan Details

Site Domain taf.by
Base Domain taf.by
Scan Status Ok
Last Scan2024-06-05T13:32:37+00:00
Next Scan 2024-07-05T13:32:37+00:00

Last Scan

Scanned2024-06-05T13:32:37+00:00
URL https://taf.by/robots.txt
Domain IPs 104.21.17.196, 172.67.178.55, 2606:4700:3033::ac43:b237, 2606:4700:3036::6815:11c4
Response IP 172.67.178.55
Found Yes
Hash 797b10eb837c0bd3e083fc19fe75a68c4f2e1ce74d3ac5b92b527de382625f0d
SimHash 48a008860531

Groups

*

Rule Path
Disallow /wp-
Disallow /xmlrpc.php
Disallow /?s=
Disallow /arenda-avtobusov/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/
Allow /wp-content/themes/
Allow *.js
Allow *.css
Allow /wp-content/plugins/*.gif
Allow /wp-content/plugins/*.png

Other Records

Field Value
sitemap https://taf.by/sitemap_index.xml