tatbik.net
robots.txt

Robots Exclusion Standard data for tatbik.net

Resource Scan

Scan Details

Site Domain tatbik.net
Base Domain tatbik.net
Scan Status Ok
Last Scan2024-06-24T00:52:38+00:00
Next Scan 2024-07-01T00:52:38+00:00

Last Scan

Scanned2024-06-24T00:52:38+00:00
URL https://www.tatbik.net/robots.txt
Domain IPs 209.250.239.112
Response IP 209.250.239.112
Found Yes
Hash f86f8c3f72e6b6fa337c83c2d61279048f9acc61646e3fa84c3e017c5165ba20
SimHash eb00583263b2

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-includes/
Allow /wp-includes/js/
Allow /wp-includes/images/

googlebot-image

Rule Path
Allow /wp-content/uploads/

Other Records

Field Value
sitemap https://www.tatbik.net/sitemap_index.xml