telcoworks.com.au
robots.txt
Robots Exclusion Standard data for telcoworks.com.au
Resource Scan
Scan Details
Site Domain | telcoworks.com.au |
Base Domain | telcoworks.com.au |
Scan Status | Ok |
Last Scan | 2024-08-24T07:45:32+00:00 |
Next Scan | 2024-09-23T07:45:32+00:00 |
Last Scan
Scanned | 2024-08-24T07:45:32+00:00 |
URL | https://telcoworks.com.au/robots.txt |
Domain IPs | 116.90.54.10 |
Response IP | 116.90.54.10 |
Found | Yes |
Hash | 69aee06a35da94054ebe5eb0d332d80d002536e590c63147b69a544240037f71 |
SimHash | 32d3d05347a7 |
Groups
*
Rule | Path |
---|---|
Disallow | /portal/ |
Disallow | /inbound-numbers/ |
Disallow | /.cache |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /_gsdata_ |
Disallow | /3rd_Party_Blasts |
Disallow | /archive |
Disallow | /buyers-guides |
Disallow | /matesrates/ |
Disallow | /marketing |
Disallow | /subscribe |
Disallow | /surveys |
Disallow | /whitepaper |
Disallow | /rates/ |
Disallow | /compliance/ |
Disallow | /cancel/ |
Disallow | /prepay/ |
Disallow | /postpay/ |
Disallow | /shop/ |
Disallow | /R/ |
Disallow | /tips |
Disallow | /signup/ |
Disallow | /plans-and-pricing/ |
Disallow | /products/ |
Disallow | /testimonials/ |
Disallow | /Testimonials/ |
Disallow | /policies/ |
Disallow | /promo-1300-numbers/ |
Disallow | /promo/ |
Disallow | /helpdesk/ |
Disallow | /help-desk/ |
Disallow | /shop/ |
Disallow | /modules/ |
Other Records
Field | Value |
---|---|
crawl-delay | 30 |
googlebot
Rule | Path |
---|---|
Disallow | /portal/ |
Disallow | /inbound-numbers/ |
Disallow | /.cache |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /_gsdata_ |
Disallow | /3rd_Party_Blasts |
Disallow | /archive |
Disallow | /buyers-guides |
Disallow | /matesrates/ |
Disallow | /marketing |
Disallow | /subscribe |
Disallow | /surveys |
Disallow | /whitepaper |
Disallow | /rates/ |
Disallow | /compliance/ |
Disallow | /cancel/ |
Disallow | /prepay/ |
Disallow | /postpay/ |
Disallow | /shop/ |
Disallow | /signup/ |
Disallow | /policies/ |
vegi bot (we follow your robots.txt settings before crawling, you can slow down the bot by change the crawl-delay parameter in the settings.if you have an enquiry, please email to: abuse-report@terrykyleseoagency.com)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; yahoo! slurp china; http://misc.yahoo.com.cn/help.html)
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0+(compatible;+becomebot/3.0;++http://www.become.com/site_owners.html)
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.telcoworks.com.au/sitemap.xml |
Warnings
- 16 invalid lines.
Comments