classting.com
robots.txt
Robots Exclusion Standard data for classting.com
Resource Scan
Scan Details
Site Domain | classting.com |
Base Domain | classting.com |
Scan Status | Ok |
Last Scan | 2024-06-03T04:28:51+00:00 |
Next Scan | 2024-06-17T04:28:51+00:00 |
Last Scan
Scanned | 2024-06-03T04:28:51+00:00 |
URL | https://classting.com/robots.txt |
Redirect | https://www.classting.com/robots.txt |
Redirect Domain | www.classting.com |
Redirect Base | classting.com |
Domain IPs | 104.22.32.100, 104.22.33.100, 172.67.15.74 |
Redirect IPs | 18.155.68.103, 18.155.68.109, 18.155.68.43, 18.155.68.99, 2600:9000:23d2:1000:7:c63e:6500:93a1, 2600:9000:23d2:2800:7:c63e:6500:93a1, 2600:9000:23d2:3200:7:c63e:6500:93a1, 2600:9000:23d2:3c00:7:c63e:6500:93a1, 2600:9000:23d2:4200:7:c63e:6500:93a1, 2600:9000:23d2:4600:7:c63e:6500:93a1, 2600:9000:23d2:ac00:7:c63e:6500:93a1, 2600:9000:23d2:f200:7:c63e:6500:93a1 |
Response IP | 18.155.68.103 |
Found | Yes |
Hash | fe65e9aaeaa653034116081cbd46af6f92a55261047e282e287cc77ff01cf063 |
SimHash | 0101d206d472 |
Groups
baiduspider
rogerbot
embedly
outbrain
pinterest
vkshare
w3c_validator
yeti
naverbot
arc reader
daum
Rule | Path |
---|---|
Allow | /app/ |
Allow | /styles/ |
Allow | /schools/ |
Allow | /intro |
Disallow | /outdated_browser.html |
Disallow | /news |
Disallow | /join |
Disallow | /share |
Disallow | /email_verfication |
Disallow | /password |
Disallow | /home |
Disallow | /apphome |
Disallow | /notifications |
Disallow | /auth/ |
Disallow | /sign_up/ |
Disallow | /sign_in/ |
Disallow | /password/ |
Disallow | /users/ |
Disallow | /settings/ |
Disallow | /classes/ |
Disallow | /popular_classes/ |
Disallow | /schools/*/register |
Disallow | /schools/*/settings |
Disallow | /schools/*/activation |
googlebot
googlebot-news
googlebot-image
googlebot-video
mediapartners-google
adsbot-google
adsbot-google-mobile-apps
apis-google
Rule | Path |
---|---|
Allow | /app/ |
Allow | /styles/ |
Allow | /schools/ |
Disallow | /outdated_browser.html |
Disallow | /news |
Disallow | /join |
Disallow | /share |
Disallow | /email_verfication |
Disallow | /password |
Disallow | /home |
Disallow | /apphome |
Disallow | /notifications |
Disallow | /auth/ |
Disallow | /sign_up/ |
Disallow | /sign_in/ |
Disallow | /password/ |
Disallow | /users/ |
Disallow | /settings/ |
Disallow | /classes/ |
Disallow | /popular_classes/ |
Disallow | /schools/*/register |
Disallow | /schools/*/settings |
Disallow | /schools/*/activation |
classting_bot
slackbot
facebookexternalhit
twitterbot
linkedinbot
quora link preview
showyoubot
Rule | Path |
---|---|
Allow | /app/ |
Allow | /styles/ |
Allow | /users/ |
Allow | /classes/ |
Allow | /schools/ |
Disallow | /outdated_browser.html |
Disallow | /news |
Disallow | /join |
Disallow | /share |
Disallow | /email_verfication |
Disallow | /password |
Disallow | /auth/ |
Disallow | /sign_up/ |
Disallow | /sign_in/ |
Disallow | /password/ |
Disallow | /settings/ |
Disallow | /classes/new |
Disallow | /classes/requests |
Disallow | /classes/*/settings |
Disallow | /classes/*/members |
Disallow | /classes/*/invitations |
Disallow | /classes/*/classboxes |
Disallow | /classes/*/counselings |
Disallow | /schools/*/register |
Disallow | /schools/*/settings |
Disallow | /schools/*/activation |
Other Records
Field | Value |
---|---|
sitemap | /sitemap.xml.gz |
Comments