manta.com
robots.txt

Robots Exclusion Standard data for manta.com

Resource Scan

Scan Details

Site Domain manta.com
Base Domain manta.com
Scan Status Ok
Last Scan2024-11-16T17:46:15+00:00
Next Scan 2024-11-23T17:46:15+00:00

Last Scan

Scanned2024-11-16T17:46:15+00:00
URL https://manta.com/robots.txt
Redirect https://www.manta.com/robots.txt
Redirect Domain www.manta.com
Redirect Base manta.com
Domain IPs 13.225.4.100, 13.225.4.126, 13.225.4.91, 13.225.4.92
Redirect IPs 104.19.208.132, 104.19.209.132, 2606:4700::6813:d084, 2606:4700::6813:d184
Response IP 104.19.208.132
Found Yes
Hash ec27c6dcb82a9f239856a9b69aacbd99fad060791ad45cd2f1a9094e83c67abe
SimHash d53a7dd83a51

Groups

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

google-inspectiontool

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

bender

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

slurp/3.0

Rule Path
Disallow /

mediapartners-google

Rule Path
Disallow /claim/
Disallow /member
Disallow /profile/
Disallow /cart/
Disallow /manta.

ccbot

Rule Path
Disallow /

*

Rule Path
Disallow /urlverify
Disallow /api/v1/urlverify
Disallow /mdir
Disallow /jobs
Disallow /manta/sample-pdf
Disallow /coms2/dnbdescription
Disallow /coms2/page_cse
Disallow /video
Disallow /coms2/page_radlink_results
Disallow /comsite5/bin/
Disallow /claim/
Disallow /member
Disallow /g/
Disallow /p/*/*/recommends
Disallow /p/*/*/following
Disallow /m/*/*/recommends
Disallow /m/*/*/following
Disallow /mb_5*_/
Allow /mb_5*0/*_/
Allow /mb_5*1/*_/
Allow /mb_5*2/*_/
Allow /mb_5*3/*_/
Allow /mb_5*4/*_/
Allow /mb_5*5/*_/
Allow /mb_5*6/*_/
Allow /mb_5*7/*_/
Allow /mb_5*8/*_/
Allow /mb_5*9/*_/
Allow /mb_5*A/*_/
Allow /mb_5*B/*_/
Allow /mb_5*C/*_/
Allow /mb_5*D/*_/
Allow /mb_5*E/*_/
Allow /mb_5*F/*_/
Allow /mb_5*G/*_/
Allow /mb_5*H/*_/
Allow /mb_5*I/*_/
Allow /mb_5*J/*_/
Allow /mb_5*K/*_/
Allow /mb_5*L/*_/
Allow /mb_5*M/*_/
Allow /mb_5*N/*_/
Allow /mb_5*O/*_/
Allow /mb_5*P/*_/
Allow /mb_5*Q/*_/
Allow /mb_5*R/*_/
Allow /mb_5*S/*_/
Allow /mb_5*T/*_/
Allow /mb_5*U/*_/
Allow /mb_5*V/*_/
Allow /mb_5*W/*_/
Allow /mb_5*X/*_/
Allow /mb_5*Y/*_/
Allow /mb_5*Z/*_/
Disallow /c/*/*/following
Disallow /cr/
Disallow /profile/
Disallow /ci/
Disallow /cs/
Disallow /cmap/
Disallow /icr
Disallow /icmap
Disallow /ics
Disallow /cart/
Disallow /world/Africa
Disallow /world/Asia
Allow /world/Europe/United%2BKingdom
Disallow /world/Europe
Disallow /world/Oceania
Allow /world/Oceania/Australia
Allow /world/Oceania/New%2BZealand
Disallow /world/South%2BAmerica
Disallow /manta.
Disallow /inv/
Disallow /cpl/
Disallow /cpl-edit/
Disallow /cp-edit/
Disallow /getlisted/
Disallow /suggestions/
Disallow /6009/*
Disallow /ng*
Disallow /fapi/
Disallow /napi/
Disallow /content-only/
Disallow /search
Disallow /track?
Disallow *.html
Disallow /stats/c/
Disallow /scan/c/
Disallow /edit/c/
Disallow /build/c/
Disallow /ebook
Disallow /empty
Disallow /unsub/

Warnings

  • 2 invalid lines.