HTTPS surface reachable (robots ✓, sitemap ✓, title ✓)
Why it matters: Public files — robots.txt, sitemap.xml, head meta — are what attackers see first during reconnaissance. Misadvertised paths, stale sitemaps, and verbose generators leak more than intended (ISO 27001 A.8.9).
robots.txt
present
User-agent: voltron
Disallow: /
# Somehow being used to fetch user profiles?
User-agent: FeedBurner/1.0 (http://www.FeedBurner.com)
Disallow: /
# Some weird backlink checker (webmeup.com)
User-agent: BLEXBot
Disallow: /
# Another backlink crawler
User-agent: linkdexbot/2.0
Disallow: /
# Another one.
User-Agent: GetintentCrawler
Disallow: /
User-agent: Cliqzbot
Disallow: /
User-agent: MJ12bot
Disallow: /
User-agent: Mail.RU_Bot
Disallow: /
User-agent: VegeBot
Disallow: /
User-agent: Vegi bot
Disallow: /
User-agent: adbeat_bot
Disallow: /
User-agent: Jooblebot
Disallow: /
User-agent: CrazyWebCrawler-Spider
Disallow: /
Allow: /api/og/*
sitemap.xml
present — 351 url(s)
head
- title
- AngelList – Build, Lead, Invest
- description
- AngelList builds the infrastructure that powers the startup economy—providing investors and innovators with the tools to grow.
social
- og:title
- AngelList – Build, Lead, Invest
- og:description
- AngelList builds the infrastructure that powers the startup economy—providing investors and innovators with the tools to grow.
- og:site_name
- AngelList
- og:locale
- en_US
- og:image
- https://cdn.sanity.io/images/q8bht0jl/production/18d644421ea19ea522e026668cfaac2c97815c09-2400x1200.jpg?rect=52,0,2297,1200&w=1200&h=627&fit=crop&auto=format
- og:image:width
- 1200
- og:image:height
- 627
- og:type
- website
- twitter:card
- summary_large_image
- twitter:creator
- @angellist
- twitter:title
- AngelList – Build, Lead, Invest
- twitter:description
- AngelList builds the infrastructure that powers the startup economy—providing investors and innovators with the tools to grow.
- twitter:image
- https://cdn.sanity.io/images/q8bht0jl/production/18d644421ea19ea522e026668cfaac2c97815c09-2400x1200.jpg?rect=52,0,2297,1200&w=1200&h=627&fit=crop&auto=format
- twitter:image:width
- 1200
- twitter:image:height
- 627