Net Labs SemSpider

Every page of your website, put under the microscope.

Weight, speed, SEO tags and internal linking: a technical audit of your website, page by page, in a few minutes.

Preview

The whole site on one screen: the summary, then one row per page

Crawl my website now →

The method

From an address to an action plan, in five steps

  1. 01

    Type

    Your website's address, with or without www.

    One address

  2. 02

    Explore

    Internal links from the home page, then the sitemap pages no link leads to.

    Up to 500 pages

  3. 03

    Measure

    The weight of each file type, TTFB, load time and requests.

    Performance

  4. 04

    Diagnose

    Over 30 checks per page and across the site, ranked by severity.

    Ranked issues

  5. 05

    Export

    Sort, filter, open every page, then export every value.

    CSV

The measures

What SemSpider measures on every page

Performance

  • Transferred weight and share of images, HTML, CSS, JS and fonts
  • TTFB: time to first byte
  • Estimated load time, fonts included
  • Number of requests
  • HTML compression (gzip, brotli)
  • Heavy images and resources in error

SEO tags

  • Title and meta description, with their length
  • Heading outline, from H1 to H6
  • Canonical, noindex and X-Robots-Tag
  • Language, hreflang and Open Graph
  • JSON-LD structured data
  • Images without alt or dimensions

Site structure

  • Click depth from the home page
  • Inbound internal links
  • Broken links and links to redirects
  • Duplicate titles, descriptions and content
  • Orphan sitemap pages
  • Pages missing from the sitemap

Benchmarks

Public thresholds, not impressions

Every colour in the table comes from a fixed, known threshold. The same threshold is used everywhere: table, detail and issue list.

Measure Threshold Benchmark
Time to first byte (TTFB) ≤ 800 ms web.dev (Google): “good” up to 800 ms
Estimated load time ≤ 3 s Beyond 3 s, mobile bounce rates climb (Google study)
Page weight ≤ 2.5 MB Lighthouse penalises total weight from about 2.6 MB
Image weight ≤ 100 KB Common optimisation benchmark for a web image
Title length (characters) 30–60 Google shows about 600 px, i.e. 55 to 60 characters
Meta description length (characters) 70–160 Google cuts the snippet at about 155 to 160 characters
Words of visible text ≥ 300 Below this, the page may be judged thin
Clicks from the home page ≤ 3 Beyond this, the page is crawled less and gets fewer links

Under the hood

A light crawler, honest about what it measures

Your browser drives

It keeps the page queue and asks the server for small batches. No crawl is stored: the results stay with you.

Real measures

The HTML and every resource are downloaded as a browser would, in parallel and compressed. A shared file is measured only once.

Polite to the website

robots.txt is followed, simultaneous connections are limited and no private network address can be reached.

No hidden approximation

The pages' JavaScript is not run: the load time is an estimate, shown as such.

Ready to put your website under the microscope?

Up to 500 pages, live results, CSV export. No account.

Start a crawl

Community

Join Net Labs on Discord

Ask questions about your analyses, discuss SEO, GEO and AI, and get early access to new tool features.

Join the Discord

Built with