getthit.com
robots.txt
Robots Exclusion Standard data for getthit.com
Resource Scan
Scan Details
Site Domain | getthit.com |
Base Domain | getthit.com |
Scan Status | Ok |
Last Scan | 2024-09-21T04:24:54+00:00 |
Next Scan | 2024-09-28T04:24:54+00:00 |
Last Scan
Scanned | 2024-09-21T04:24:54+00:00 |
URL | https://getthit.com/robots.txt |
Redirect | https://www.getthit.com/robots.txt |
Redirect Domain | www.getthit.com |
Redirect Base | getthit.com |
Domain IPs | 104.21.53.60, 172.67.209.97, 2606:4700:3030::ac43:d161, 2606:4700:3034::6815:353c |
Redirect IPs | 104.21.53.60, 172.67.209.97, 2606:4700:3030::ac43:d161, 2606:4700:3034::6815:353c |
Response IP | 104.21.53.60 |
Found | Yes |
Hash | 584081328879ee5fec4f4c2c73b8d510b8085d605b8f2b7619efcf38a9503993 |
SimHash | 892c8c641262 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Allow | /get-organic-website-traffic |
Allow | /increase-website-traffic-for-free |
Allow | /drive-traffic-to-your-website |
Allow | /get-social-media-traffic |
Allow | /free-website-traffic-bot |
Allow | /boost-website-traffic |
Allow | /signin |
Allow | /how-it-works |
Allow | /faq |
Allow | /signup |
Allow | /sitemap |
Allow | /contactUs |
Allow | /our-block-list |
Allow | /privacypolicy |
Allow | /terms-of-service |
Allow | /forgetpassword |
Allow | /bot |
Allow | /accessdenied |
Allow | /erroroccurred |
Allow | /pagenotfound |
Allow | /upgradeRequired |
Allow | /updateRequired |
Allow | /pageunderconstruction |
Allow | /websiteundermaintenance |
Allow | /online-word-counter |
Allow | /unique-value-finder |
Allow | /random-guid-generator-online |
Allow | /temporary-gmail-checker-online |
Allow | /domain-extractor-online |
Allow | /tools/ |
Allow | /tools/* |
Allow | /blog |
Allow | /blog/ |
Allow | /blog/* |
Allow | /wiki |
Allow | /wiki/ |
Allow | /wiki/* |
Allow | /getthit-videos |
Allow | /getthit-fans-videos |
Allow | /about-us |
Allow | /pages.getthit.com/assets/* |
Allow | /pages.getthit.com/GettHitAssets/* |
Disallow | /signinredirect |
Disallow | /dashboard |
Disallow | /earntraffic |
Disallow | /myreferrals |
Disallow | /mysettings |
Disallow | /changepassword |
Disallow | /forgetpasswordcodeexpired |
Disallow | /verifyforgetpassword |
Disallow | /signUpVerificationIdExpired |
Disallow | /signUpVerificationPending |
Disallow | /signUpVerificationPendingSignIn |
Disallow | /userVerified |
Disallow | /verificationCodeExpired |
Disallow | /verifyuseremailaddress |
Disallow | /adblocked.html |
Disallow | /devToolsNotAllowed.html |
Disallow | /cdn-cgi/l/email-protection |
Disallow | /reporttraficexlink/* |
Disallow | /reporttraficexlink* |
Disallow | /reporttraficexlink/domain |
Disallow | /reporttraficexlink/link |
Disallow | /_framework/dotnet* |
Disallow | /blob%3A* |
Disallow | *.googlevideo.com/* |
Disallow | *googlevideo.com/* |
Disallow | *status.getthit.com* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://www.getthit.com/sitemap.xml |
sitemap | https://www.getthit.com/sitemap-blog.xml |
sitemap | https://www.getthit.com/sitemap-wiki.xml |
sitemap | https://www.getthit.com/sitemap-wiki-tag.xml |
sitemap | https://www.getthit.com/sitemap-tools.xml |
Comments