betterme.world
robots.txt
Robots Exclusion Standard data for betterme.world
Resource Scan
Scan Details
Site Domain | betterme.world |
Base Domain | betterme.world |
Scan Status | Ok |
Last Scan | 2024-06-28T20:12:53+00:00 |
Next Scan | 2024-07-05T20:12:53+00:00 |
Last Scan
Scanned | 2024-06-28T20:12:53+00:00 |
URL | https://betterme.world/robots.txt |
Domain IPs | 18.216.183.216, 3.131.126.208 |
Response IP | 3.131.126.208 |
Found | Yes |
Hash | e0c2c57202f87f15f7e2d90e307ca5ef48c8beb883b76e3e71ec00221bcad9c0 |
SimHash | 2145852b49b1 |
Groups
*
Rule | Path |
---|---|
Disallow | /articles/cgi-bin |
Disallow | /articles/wp-admin |
Disallow | /articles/wp-includes |
Disallow | /articles/wp-content/plugins |
Disallow | /articles/wp-feed |
Disallow | /articles/wp-comments |
Disallow | /articles/?s= |
Disallow | /articles/?amp= |
Disallow | *?attachment_id= |
Disallow | *?utm_source= |
Disallow | */feed |
Disallow | */rss |
Disallow | */embed |
Disallow | */goto/ |
Disallow | *?q= |
Disallow | /for-testing |
Allow | /articles/wp-content/uploads/ |
Allow | /articles/wp-content/themes/ |
Allow | /*/*.js |
Allow | /*/*.css |
Allow | /articles/wp-*.png |
Allow | /articles/wp-*.jpg |
Allow | /articles/wp-*.jpeg |
Allow | /articles/wp-*.gif |
Allow | /articles/wp-*.svg |
Allow | /articles/wp-*.pdf |
Other Records
Field | Value |
---|---|
sitemap | https://betterme.world/articles/sitemap.xml |