inspiringinterns.com
robots.txt

Robots Exclusion Standard data for inspiringinterns.com

Resource Scan

Scan Details

Site Domain inspiringinterns.com
Base Domain inspiringinterns.com
Scan Status Ok
Last Scan2025-10-21T06:32:30+00:00
Next Scan 2025-11-20T06:32:30+00:00

Last Scan

Scanned2025-10-21T06:32:30+00:00
URL https://inspiringinterns.com/robots.txt
Domain IPs 104.21.1.5, 172.67.186.114, 2606:4700:3032::ac43:ba72, 2606:4700:3035::6815:105
Response IP 104.21.1.5
Found Yes
Hash f7e9e3c3405a64b8c1720956213dc955aed10ec6ac2b5594ab157bb457470667
SimHash b59ddefbdc1a

Groups

*

Rule Path
Disallow /images/
Disallow /fonts/
Disallow /uploads/
Disallow /video/
Disallow /under-maintenance.html
Disallow /template.php
Disallow /404.html
Disallow /public/
Disallow /bullhorn/
Disallow /employers/add-job-spec
Disallow /candidates/register/error
Disallow /cron
Disallow /cronautoemail
Disallow /cronautoemailreset
Disallow /cronautomemailplacement
Disallow /cronautoemailcandidatesales
Disallow /cronautoemailremindowner
Disallow /autoemailresetremindowner
Disallow /autojobpostingtomonsteretc
Disallow /cronautomemailfeefo
Disallow /cronautoemailplacementvsexistent
Disallow /cronautoemailtoamaregisteredreapply
Disallow /cronautoemailtoamaregisteredreapplyreset
Disallow /cronautomatchcandidateandspec
Disallow /cronautoremindplacement10weeks
Disallow /cronautoundergrad
Disallow /cronautosalescandidateglen
Disallow /autoemailjobaddeddaily
Disallow /feefotoinspiring
Disallow /candidates/apply/directtoemployer
Disallow /candidates/apply/direct
Disallow /cronautoremindplacement10weeks
Disallow /cronautointernshipendreminder/
Disallow /cronautoplacementfeedback
Disallow /cronautocandidategoldplatinum
Disallow /advice-for-employers
Disallow /graduate-careers-advice
Disallow /mobivate
Disallow /bookings/faqs
Disallow /test
Disallow /autojobpostingtomonsteretcbydaterange
Disallow /cronautomemailplacementextensionftfi
Disallow /autoemailadayinthelife
Disallow /cronautoemailtoamwhencandidateapply
Disallow /autoemailplacementeffectivedate
Disallow /addcandidatetoshortlist
Disallow /jobspecs
Disallow /autoemailplacementeffectivedatemultimonths
Disallow /updatevideotags/
Disallow /cronautomemailreferafriend
Disallow /autoemaildailycandidates
Disallow /autoemailcandidatesmatchnewjobadded
Disallow /employers/e-book-a-guide-to-hiring-graduates
Disallow /candidates/employment-status-update-email/
Disallow /candidates/employment-status-update/
Disallow /unsubscribe
Disallow /parseUserToBhCronjob
Disallow /mapCandidateToUserCronjob
Disallow /getRegisteredCandidatesCronjob
Disallow /getOpenJobsCronjob
Disallow /blog/2009
Disallow /blog/2010
Disallow /blog/2011
Disallow /blog/2012
Disallow /blog/2013
Disallow /blog/2014
Disallow /blog/2015
Disallow /blog/2016
Disallow /contact-candidate
Disallow /getjob
Disallow /recover

blexbot
ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 28840