dating.thunderboltcity.co.za
robots.txt
Robots Exclusion Standard data for dating.thunderboltcity.co.za
Resource Scan
Scan Details
| Site Domain | dating.thunderboltcity.co.za |
| Base Domain | thunderboltcity.co.za |
| Scan Status | Ok |
| Last Scan | 2024-09-16T19:05:30+00:00 |
| Next Scan | 2024-09-30T19:05:30+00:00 |
Last Scan
| Scanned | 2024-09-16T19:05:30+00:00 |
| URL | https://dating.thunderboltcity.co.za/robots.txt |
| Response IP | 212.32.224.181 |
| Found | Yes |
| Hash | d03c451c07ca66e0720ed99ad6223a0dc1d7ddd693a10929ec3631f59c677080 |
| SimHash | a8617aefd071 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /$ |
| Disallow | /*?$ |
| Disallow | /*?click |
| Disallow | /*?cta |
| Disallow | /*?gclid |
| Disallow | /*?lc= |
| Disallow | /*php/ |
| Disallow | /*?ref= |
| Disallow | /*?s3= |
| Disallow | /*?set |
| Disallow | /*?sid |
| Disallow | /*?urlChanged |
| Disallow | /*?utm |
| Disallow | /?*= |
| Disallow | /ads/ |
| Disallow | /c/ |
| Disallow | /faq |
| Disallow | /help |
| Disallow | /index |
| Disallow | /js/$ |
| Disallow | /js/*.r*.js |
| Disallow | /js/facebook |
| Disallow | /js/vendor |
| Disallow | /login |
| Disallow | /maintenance |
| Disallow | /s$ |
| Disallow | /s/*/1000$ |
| Disallow | /s/*?a= |
| Disallow | /s/*?abuse= |
| Disallow | /s/*?action= |
| Disallow | /s/*?c= |
| Disallow | /s/*?conn |
| Disallow | /s/*?fpPage= |
| Disallow | /s/*?js= |
| Disallow | /s/*?m= |
| Disallow | /s/*?mode= |
| Disallow | /s/*?override |
| Disallow | /s/*?p= |
| Disallow | /s/*?page= |
| Disallow | /s/*?rb= |
| Disallow | /s/*?reset= |
| Disallow | /s/*?searchType= |
| Disallow | /s/*?session |
| Disallow | /s/*?source= |
| Disallow | /s/*?type= |
| Disallow | /s/*err%3Derr_ |
| Disallow | /s// |
| Disallow | /s/?*= |
| Disallow | /s/a/ |
| Disallow | /s/admin/ |
| Disallow | /s/aff |
| Disallow | /s/afw/ |
| Disallow | /s/app/ |
| Disallow | /s/buzz/*/ |
| Disallow | /s/c/*~ |
| Disallow | /s/c/*_ |
| Disallow | /s/c/*/? |
| Disallow | /s/c/*/$ |
| Disallow | /s/c/*/*/ |
| Disallow | /s/c/*. |
| Disallow | /s/c/*%28 |
| Disallow | /s/c/*% |
| Disallow | /s/c/*/A |
| Disallow | /s/c/*/B |
| Disallow | /s/c/*/C |
| Disallow | /s/c/*/D |
| Disallow | /s/c/*/E |
| Disallow | /s/c/*/F |
| Disallow | /s/c/*/G |
| Disallow | /s/c/*/H |
| Disallow | /s/c/*/I |
| Disallow | /s/c/*/J |
| Disallow | /s/c/*/K |
| Disallow | /s/c/*/L |
| Disallow | /s/c/*/M |
| Disallow | /s/c/*/N |
| Disallow | /s/c/*/O |
| Disallow | /s/c/*/P |
| Disallow | /s/c/*/Q |
| Disallow | /s/c/*/R |
| Disallow | /s/c/*/S |
| Disallow | /s/c/*/T |
| Disallow | /s/c/*/U |
| Disallow | /s/c/*/V |
| Disallow | /s/c/*/W |
| Disallow | /s/c/*/X |
| Disallow | /s/c/*/Y |
| Disallow | /s/c/*/Z |
| Disallow | /s/CatnipForNaughtyRobots |
| Disallow | /s/chat |
| Disallow | /s/conf |
| Disallow | /s/d/ |
| Disallow | /s/dnfb/ |
| Disallow | /s/feed/f |
| Disallow | /s/find$ |
| Disallow | /s/find/?*= |
| Disallow | /s/find/byna |
| Disallow | /s/find/loggedi |
| Disallow | /s/find/more |
| Disallow | /s/find/tell.php |
| Disallow | /s/g/*/*/ |
| Disallow | /s/help$ |
| Disallow | /s/help/blo |
| Disallow | /s/help/chart |
| Disallow | /s/help/faq.php?*= |
| Disallow | /s/help/networks |
| Disallow | /s/home |
| Disallow | /s/index |
| Disallow | /s/info$ |
| Disallow | /s/info/$ |
| Disallow | /s/join$ |
| Disallow | /s/join/w |
| Disallow | /s/joined |
| Disallow | /s/l/ |
| Disallow | /s/lnk/ |
| Disallow | /s/login$ |
| Disallow | /s/login/? |
| Disallow | /s/login/do |
| Disallow | /s/mail$ |
| Disallow | /s/mail/$ |
| Disallow | /s/mail/conversation.php |
| Disallow | /s/mail/inbox |
| Disallow | /s/mail/outbox |
| Disallow | /s/mail/write |
| Disallow | /s/p/*~ |
| Disallow | /s/p/*/?*= |
| Disallow | /s/p/*/$ |
| Disallow | /s/p/*/*/ |
| Disallow | /s/p/*/A |
| Disallow | /s/p/*/B |
| Disallow | /s/p/*/C |
| Disallow | /s/p/*/D |
| Disallow | /s/p/*/E |
| Disallow | /s/p/*/F |
| Disallow | /s/p/*/G |
| Disallow | /s/p/*/H |
| Disallow | /s/p/*/I |
| Disallow | /s/p/*/J |
| Disallow | /s/p/*/K |
| Disallow | /s/p/*/L |
| Disallow | /s/p/*/M |
| Disallow | /s/p/*/N |
| Disallow | /s/p/*/O |
| Disallow | /s/p/*/P |
| Disallow | /s/p/*/Q |
| Disallow | /s/p/*/R |
| Disallow | /s/p/*/S |
| Disallow | /s/p/*/T |
| Disallow | /s/p/*/U |
| Disallow | /s/p/*/V |
| Disallow | /s/p/*/W |
| Disallow | /s/p/*/X |
| Disallow | /s/p/*/Y |
| Disallow | /s/p/*/Z |
| Disallow | /s/p/*_ |
| Disallow | /s/part |
| Disallow | /s/prof |
| Disallow | /s/prom |
| Disallow | /s/q/ |
| Disallow | /s/r/*~ |
| Disallow | /s/r/*/?*= |
| Disallow | /s/r/*/$ |
| Disallow | /s/r/*/*/ |
| Disallow | /s/r/*/A |
| Disallow | /s/r/*/B |
| Disallow | /s/r/*/C |
| Disallow | /s/r/*/D |
| Disallow | /s/r/*/E |
| Disallow | /s/r/*/F |
| Disallow | /s/r/*/G |
| Disallow | /s/r/*/H |
| Disallow | /s/r/*/I |
| Disallow | /s/r/*/J |
| Disallow | /s/r/*/K |
| Disallow | /s/r/*/L |
| Disallow | /s/r/*/M |
| Disallow | /s/r/*/N |
| Disallow | /s/r/*/O |
| Disallow | /s/r/*/P |
| Disallow | /s/r/*/Q |
| Disallow | /s/r/*/R |
| Disallow | /s/r/*/S |
| Disallow | /s/r/*/T |
| Disallow | /s/r/*/U |
| Disallow | /s/r/*/V |
| Disallow | /s/r/*/W |
| Disallow | /s/r/*/X |
| Disallow | /s/r/*/Y |
| Disallow | /s/r/*/Z |
| Disallow | /s/r/*_ |
| Disallow | /s/s/ |
| Disallow | /s/splash/pop |
| Disallow | /s/subscribe/$ |
| Disallow | /s/subscribe/? |
| Disallow | /s/subscribe/now |
| Disallow | /s/subscribe/why |
| Disallow | /s/view// |
| Disallow | /s/view/*/*/ |
| Disallow | /s/x |
| Allow | /s/$ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dating.thunderboltcity.co.za/s/i1_44_dictionary.xml |
Comments