{"record":{"id":"06bc8493a7839330","repo":"jackwener/OpenCLI","slug":"hf-datasets-limit-must-be-100","errorCode":null,"errorMessage":"hf datasets limit must be <= 100","messagePattern":"hf datasets limit must be <= 100","errorType":"validation","errorClass":"ArgumentError","httpStatus":null,"severity":"error","filePath":"clis/hf/datasets.js","lineNumber":37,"sourceCode":"    browser: false,\n    args: [\n        { name: 'sort', type: 'string', default: 'downloads', help: `Sort key: ${SORT_OPTIONS.join(', ')}` },\n        { name: 'search', type: 'string', required: false, help: 'Optional name/owner substring filter.' },\n        { name: 'limit', type: 'int', default: 20, help: 'Max datasets (max 100; one API page).' },\n    ],\n    columns: ['rank', 'id', 'author', 'downloads', 'likes', 'tags', 'lastModified', 'url'],\n    func: async (args) => {\n        const sortRaw = String(args.sort ?? 'downloads').toLowerCase();\n        const sort = SORT_ALIAS[sortRaw] ?? sortRaw;\n        if (!SORT_OPTIONS.includes(sort)) {\n            throw new ArgumentError(`hf datasets sort must be one of ${SORT_OPTIONS.join(', ')}`);\n        }\n        const limit = Number(args.limit ?? 20);\n        if (!Number.isInteger(limit) || limit <= 0) {\n            throw new ArgumentError('hf datasets limit must be a positive integer');\n        }\n        if (limit > 100) {\n            throw new ArgumentError('hf datasets limit must be <= 100');\n        }\n\n        const url = new URL('https://huggingface.co/api/datasets');\n        url.searchParams.set('sort', sort);\n        url.searchParams.set('direction', '-1');\n        url.searchParams.set('limit', String(limit));\n        url.searchParams.set('full', 'true');\n        if (args.search) url.searchParams.set('search', String(args.search));\n\n        let resp;\n        try {\n            resp = await fetch(url, {\n                headers: {\n                    'Accept': 'application/json',\n                    'User-Agent': 'opencli/1.0 (+https://github.com/jackwener/opencli)',\n                },\n            });\n        } catch (error) {","sourceCodeStart":19,"sourceCodeEnd":55,"githubUrl":"https://github.com/jackwener/OpenCLI/blob/49907e53dc3ade5c223ff0c4c2c2785687cec4e6/clis/hf/datasets.js#L19-L55","documentation":"The hf datasets command caps limit at 100 to keep the Hugging Face API query bounded; any limit above 100 throws ArgumentError. The cap mirrors the practical page-size limit of the datasets listing endpoint.","triggerScenarios":"Calling hf datasets with --limit 101 or higher, e.g. --limit 500 to try to dump many datasets in one call.","commonSituations":"Users attempting bulk exports in one request; scripts with large default limits; misunderstanding that the CLI paginates (it does not — it slices a single API call).","solutions":["Use --limit 100 or less per call","Issue multiple calls with different sort/filter criteria to cover more datasets","Query the HF API directly with pagination (Link header) if you need more than 100 results","Adjust scripts that assumed unbounded limits"],"exampleFix":"// before\nhf datasets --limit 500\n// after\nhf datasets --limit 100  # repeat with different filters as needed","handlingStrategy":"validation","validationCode":"const limit = Number(rawLimit ?? 20);\nif (limit > 100) throw new Error('limit must be <= 100');","typeGuard":"function isBoundedLimit(v) { const n = Number(v); return Number.isInteger(n) && n > 0 && n <= 100; }","tryCatchPattern":"try { await hfDatasets({ limit }); } catch (e) { if (e instanceof ArgumentError && e.message.includes('limit must be <= 100')) { limit = 100; return hfDatasets({ limit }); } throw e; }","preventionTips":["Clamp limit to 100 before invoking","Paginate via multiple calls or direct API with Link headers for more data","Avoid bulk-export assumptions in scripts","Document the 100 cap in any wrapper tooling"],"tags":["validation","arguments","cli","limits"],"backgroundTag":"invalid-argument-value","analyzedSha":"49907e53dc3ade5c223ff0c4c2c2785687cec4e6","analyzedAt":"2026-08-29T08:14:47.543Z","schemaVersion":2},"datasetVersion":"2026-08-29T12:17:43.993Z"}