bikroay.com
robots.txt
Robots Exclusion Standard data for bikroay.com
Resource Scan
Scan Details
Site Domain | bikroay.com |
Base Domain | bikroay.com |
Scan Status | Ok |
Last Scan | 2024-05-25T17:40:33+00:00 |
Next Scan | 2024-06-24T17:40:33+00:00 |
Last Scan
Scanned | 2024-05-25T17:40:33+00:00 |
URL | https://bikroay.com/robots.txt |
Domain IPs | 191.101.228.9, 2a02:4780:38:75aa:bff2:b441:83c:a9f7 |
Response IP | 91.108.100.150 |
Found | Yes |
Hash | a188622723a12834dae4d0e4c6dc04f0b40336510f82cfccbdda480c0d3f34cb |
SimHash | 79145c36411b |
Groups
*
Rule | Path |
---|---|
Disallow | |
Allow | / |
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /ajax/ |
Disallow | /assets/ |
Disallow | /css/ |
Disallow | /js/ |
Disallow | /vendor/ |
Disallow | /main.php |
Disallow | /index.php |
Disallow | /mix-manifest.json |
Disallow | /lang/en |
Disallow | /lang/bn |
Disallow | /auth/facebook |
Disallow | /auth/linkedin |
Disallow | /auth/twitter |
Disallow | /auth/google |
Other Records
Field | Value |
---|---|
sitemap | https://bikroay.com/bd/sitemaps.xml |