io.github.77777R7/octocrawl

Est-ce que io.github.77777R7/octocrawl est sûr ?

Au dernier audit MCP Hub, le serveur MCP « io.github.77777R7/octocrawl » est classé « Non encore testé ». Référencé dans l'annuaire. Seul le pentest comportemental fait foi, et il n'a pas encore été exécuté sur ce serveur. Le verdict est réévalué en continu ; consultez la fiche pour l'état à jour.

Méthode : MCP Hub analyse la description de chaque outil (couche 1) et, pour le verdict fort, exécute le serveur dans une micro-VM isolée avec leurres et réseau bloqué (couche 2). On publie des noms et des compteurs, jamais le contenu brut renvoyé par un outil.

Les 2 outils

• map≈ 1164 tokens

  List a site's URLs without reading each page: the start page's links (read over HTTP alone) and the entries of the sitemaps the site declares, within one deadline. URLs stay in scope (the start host and its www twin, the start path's subtree, assets left out, similar URLs folded) and robots.txt applies unless ignoreRobotsTxt is set; what was left out is counted. No page title is fetched. At the deadline the answer is what was found (partial, stoppedBy timeout). Compact by default; debug adds each link's evidence and the sources read. Not for: reading pages, as one page body is read at most.

  Paramètres, retour & exemple (15)

  Paramètres

  • url · string · requis
    http(s) URL of the start page
  • mode · string · optionnel · standard | research
    The declared identity robots.txt, the page and the sitemaps are read under. authed is not offered: a map reads public sitemaps and one public page.
  • debug · boolean · optionnel
    Return the full map response instead of the compact one.
  • limit · integer · optionnel
    Links returned at most. Default 5000; a hosted server takes up to 5000. Reaching it is status completed with stoppedBy limit.
  • search · string · optionnel
    Keep only the URLs in which every word (at most 10) appears, case-insensitively, in the decoded URL or its title. A filter, not a ranking: the order stays the discovery order, and limit counts the matches.
  • sitemap · string · optionnel · include | skip | only
    include (default): the start page's links and the sitemaps. skip: no sitemap is read. only: no page is read; the links are the sitemap entries in their listed order (the start URL only when a sitemap lists it).
  • timeout · integer · optionnel
    Milliseconds for the whole map. Default 60000; a hosted server takes up to 60000.
  • integration · string · optionnel
    Your workflow label (printable, no spaces); recorded, not sent to sites.
  • excludePaths · array · optionnel
    Pathname regexes that leave a URL out; they win over includePaths.
  • includePaths · array · optionnel
    Pathname regexes a URL must match.
  • regexOnFullURL · boolean · optionnel
    Match includePaths and excludePaths against the canonical URL instead of its pathname. Default false.
  • crawlEntireDomain · boolean · optionnel
    Admit URLs anywhere on the start host, not only in the start URL's path subtree. Default false.
  • includeSubdomains · boolean · optionnel
    Admit every host under the start URL's apex (the host with one leading www. removed; no public-suffix list). Default false. Each new host's robots.txt is read, for at most 20 hosts.
  • ignoreQueryParameters · boolean · optionnel
    Fold URLs that differ only in their query string into the first one seen, returned without its query; each merge is counted (refused.collapsed, with samples under debug). Default false.
  • deduplicateSimilarURLs · boolean · optionnel
    Fold /a and /a/, / and /index.html, www and apex, http and https into one URL. Default true.

  Exemple d'appel

  {"name": "map", "arguments": {"url": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}], "structuredContent": {"id": "texte", "links": [], "counts": {}, "status": "completed", "warning": "texte", "stoppedBy": "limit", "agentHints": []}}

• scrape≈ 2048 tokens

  Read one URL as Markdown with its Evidence Record (final URL, fetch time, HTTP status, robots.txt decision, hashes), over HTTP first and in the browser when the page needs it. Not for: many URLs or a whole site section. Compact by default; debug adds the full audit. warnings name what the content cannot vouch for (client_rendered_suspected, robots_overridden), and agentHints the next step.

  Paramètres, retour & exemple (18)

  Paramètres

  • url · string · requis
    An http(s) URL.
  • mode · string · optionnel · standard | research
    The declared identity the page is read under: standard (default) or research. A hosted server holds no saved logins, so it has no authed mode.
  • debug · boolean · optionnel
    Return the full audit: trace, ladderTrace and every attempt.
  • mobile · boolean · optionnel
    Read as declared mobile Chrome (Android UA, 412x915). Default false.
  • verify · object · optionnel
    Checks on final delivery; passed covers configured checks only. Inspect failure/readiness before retrying. Types: markdownIncludes, markdownMatches, markdownCountMin, minTables, tableRowsMin (tables format, zero-based columns), listRecordsMin, recordFields (uniqueBy counts complete extracted identities), field. Markdown checks need markdown format.
  • formats · array · optionnel
    What to return (default markdown): markdown, links, html, rawHtml, images, tables, json, attributes ({ selectors }), list ({ itemSelector?, fields? }: a record per repeated item, detected without itemSelector), screenshot or screenshot@fullPage (browser only). This connection has no browser lane, so it offers no screenshot.
  • headers · object · optionnel
    Extra headers to the page's origin, recorded; User-Agent, client hints, authorization and cookie are refused.
  • timeout · integer · optionnel
    Deadline in milliseconds for the whole scrape. When it fires the result is partial with the content so far, or failed/timeout. Here at most and by default 100000; a longer one is lowered to it.
  • blockAds · boolean · optionnel
    Block ad hosts and ad or cookie-banner elements in the browser. Default true.
  • fastMode · boolean · optionnel
    HTTP only: a page needing scripts returns the HTTP verdict (a shell is failed/empty_unverified). Default false.
  • excludeTags · array · optionnel
    CSS selectors removed with their contents.
  • includeTags · array · optionnel
    CSS selectors of the only elements to keep, whatever onlyMainContent says (no sibling combinators, :nth-child or :has).
  • integration · string · optionnel
    Your workflow label (printable, no spaces); recorded, not sent to sites.
  • includeLinks · boolean · optionnel
    Also return the page's outbound links. Default false.
  • maxFileBytes · integer · optionnel
    Largest file to download; a larger one is failed/body_too_large.
  • onlyMainContent · boolean · optionnel
    false keeps the whole page (header, navigation, footer). Default true.
  • allowlistedDomains · array · optionnel
  • removeBase64Images · boolean · optionnel
    Drop data: URI images from the Markdown, keeping alt text. Default true.

  Exemple d'appel

  {"name": "scrape", "arguments": {"url": "texte"}}

  Exemple de retour

  {"content": [{"type": "text", "text": "…"}], "structuredContent": {"status": "success", "finalUrl": "texte", "markdown": "texte", "readiness": {}, "truncated": true, "agentHints": [], "blockReason": "cloudflare_challenge", "truncatedAt": 1, "verification": {}, "failureReason": "empty_unverified", "evidenceRecord": {}}}

C'est votre serveur ?

Revendiquez-le sur l'espace créateur (preuve GitHub, domaine ou npm) pour afficher le badge « propriétaire vérifié » et lancer un pentest comportemental à la demande afin d'obtenir le badge « Vérifié ».

Créer un compte / revendiquer →

Source

https://mcp.octocrawl.dev/mcp