muemo データ管理

パイプライン実行

各タスクはバックグラウンドで起動し、logs/ にログを書き出します。長時間タスク（collect/push）はログで進捗を確認してください。

スキーマ適用 (migrate)
seed 取込 (import-seed)
文化庁 取込 (import-bunka)
機械判定 (machine-judge)
収集 (collect N件)
LLM掃き出し (export_for_extract)
LLM掃き出し (bunka list)
LLM結果取込 (import_extract)
LLM結果取込 (import-llm-list)
名寄せ候補生成 (match-qid N件)
名寄せ適用 (apply-qid)
画像収集 (collect-images N件)
push (dry-run)
push (本投入 --commit)
休館push (dry-run)
休館push (本投入 --commit)
画像push (dry-run)
画像push (本投入 --commit)
画像帰属の掃除 (dry-run)
画像帰属の掃除 (作業DB --commit)
分類監査 (audit-category)
分類適用 (dry-run)
分類適用 (作業DB --commit)
URL健全性チェック (dry-run)
URL健全性チェック (fixed反映 --commit)
URL差し替え適用 (dry-run)
URL差し替え適用 (作業DB --commit)
閉館一括適用 (dry-run)
閉館一括適用 (作業DB --commit)

ログ

web-check-urls-20260714_164446.log 07/14 16:48
web-apply-category-20260714_164432.log 07/14 16:44
web-match-qid-20260702_221059.log 07/02 22:11
web-collect-images-20260702_221049.log 07/02 22:10
web-match-qid-20260702_145944.log 07/02 14:59
web-push-images-commit-20260702_145649.log 07/02 14:56
web-push-commit-20260702_145641.log 07/02 14:56
web-collect-images-20260702_130030.log 07/02 13:04
web-match-qid-20260702_081933.log 07/02 08:28
web-push-images-commit-20260702_081931.log 07/02 08:19
web-collect-images-20260702_030625.log 07/02 03:10
web-match-qid-20260702_023506.log 07/02 02:47
web-match-qid-20260702_022431.log 07/02 02:36
web-push-commit-20260702_023325.log 07/02 02:33
web-push-images-commit-20260702_023321.log 07/02 02:33
web-collect-images-20260702_021558.log 07/02 02:18
web-push-images-commit-20260702_021554.log 07/02 02:15
web-collect-images-20260702_015617.log 07/02 01:57
web-collect-images-20260702_012336.log 07/02 01:25
web-match-qid-20260702_011426.log 07/02 01:17
web-match-qid-20260702_010204.log 07/02 01:14
web-collect-images-20260702_011408.log 07/02 01:14
web-push-images-commit-20260702_010120.log 07/02 01:01
web-collect-images-20260702_002349.log 07/02 00:29
web-match-qid-20260701_232237.log 07/01 23:34
web-push-images-commit-20260701_232835.log 07/01 23:28
web-match-qid-20260701_231137.log 07/01 23:23
web-collect-images-20260701_231140.log 07/01 23:12
web-match-qid-20260701_194150.log 07/01 19:50
web-push-images-commit-20260701_191038.log 07/01 19:10
web-collect-images-20260701_185836.log 07/01 18:59
web-push-images-commit-20260701_170022.log 07/01 17:00
web-collect-images-20260701_163613.log 07/01 16:40
web-match-qid-20260701_162842.log 07/01 16:28
web-push-commit-20260701_152932.log 07/01 15:29
web-collect-images-20260701_152410.log 07/01 15:24
web-collect-images-20260701_144911.log 07/01 14:49
web-push-images-commit-20260701_111125.log 07/01 11:11
web-collect-images-20260701_095254.log 07/01 09:58
web-match-qid-20260701_072311.log 07/01 07:32
web-push-images-commit-20260701_072240.log 07/01 07:22
web-collect-images-20260701_071414.log 07/01 07:15
web-match-qid-20260701_022830.log 07/01 02:38
web-push-images-commit-20260630_235133.log 06/30 23:51
web-collect-images-20260630_232506.log 06/30 23:26
web-push-images-commit-20260630_203320.log 06/30 20:33
web-push-images-commit-20260630_202123.log 06/30 20:21
web-collect-images-20260630_201940.log 06/30 20:19
web-push-images-commit-20260630_195718.log 06/30 19:57
web-push-images-commit-20260630_195527.log 06/30 19:55
web-apply-qid-20260630_194517.log 06/30 19:45
web-match-qid-20260630_193138.log 06/30 19:42
web-push-images-commit-20260630_193235.log 06/30 19:32
web-push-images-commit-20260630_184956.log 06/30 18:49
web-collect-images-20260630_184918.log 06/30 18:49
web-apply-qid-20260630_184915.log 06/30 18:49
web-match-qid-20260630_181249.log 06/30 18:24
web-push-images-commit-20260630_181147.log 06/30 18:11
web-collect-images-20260630_165714.log 06/30 16:57
web-push-images-commit-20260630_165309.log 06/30 16:53
web-push-images-commit-20260630_145959.log 06/30 15:00
web-push-images-commit-20260630_141039.log 06/30 14:10
web-push-images-commit-20260630_135817.log 06/30 13:58
web-push-commit-20260629_014640.log 06/29 01:46
web-push-20260629_014625.log 06/29 01:46
web-push-commit-20260629_005453.log 06/29 00:54
web-push-commit-20260629_005029.log 06/29 00:50
web-push-commit-20260629_005027.log 06/29 00:50
web-push-commit-20260629_005024.log 06/29 00:50
web-push-commit-20260629_005019.log 06/29 00:50
web-push-closures-commit-20260629_003904.log 06/29 00:39
web-push-commit-20260629_003830.log 06/29 00:38
web-import-extract-20260629_003738.log 06/29 00:37
web-import-extract-20260629_003624.log 06/29 00:36
web-import-extract-20260628_210408.log 06/28 21:04
web-import-extract-20260628_171102.log 06/28 17:11
web-import-extract-20260628_153911.log 06/28 15:39
web-import-extract-20260628_153858.log 06/28 15:39
web-import-extract-20260628_153848.log 06/28 15:38
web-import-extract-20260628_153831.log 06/28 15:38
web-import-extract-20260626_190004.log 06/26 19:00
web-import-extract-20260626_163655.log 06/26 16:36
web-push-closures-commit-20260626_162548.log 06/26 16:25
web-import-extract-20260626_145240.log 06/26 14:52
web-import-extract-20260626_130123.log 06/26 13:01
web-push-commit-20260626_124727.log 06/26 12:47
web-import-extract-20260626_124700.log 06/26 12:47
web-push-commit-20260626_122227.log 06/26 12:22
web-push-commit-20260626_122032.log 06/26 12:20
web-push-commit-20260625_205314.log 06/25 20:53
web-import-extract-20260625_205157.log 06/25 20:51
web-push-closures-commit-20260625_195147.log 06/25 19:51
web-push-commit-20260625_131213.log 06/25 13:12
web-push-commit-20260624_195911.log 06/24 19:59
web-push-commit-20260624_162214.log 06/24 16:22
web-push-commit-20260624_153733.log 06/24 15:37
web-push-commit-20260624_124514.log 06/24 12:45
web-push-20260624_124504.log 06/24 12:45
web-push-20260624_124452.log 06/24 12:44
web-push-commit-20260623_212610.log 06/23 21:26
web-push-20260623_212552.log 06/23 21:25
web-import-llm-list-20260623_184022.log 06/23 18:40
web-import-llm-list-20260622_032203.log 06/22 03:22
web-import-llm-list-20260622_031843.log 06/22 03:18
web-export-llm-list-20260621_092056.log 06/21 09:20
web-machine-judge-20260620_153829.log 06/20 15:38
web-collect-20260620_153652.log 06/20 15:36
web-import-bunka-20260620_153510.log 06/20 15:35
web-import-llm-list-20260623_184022.log 再読み込み 
[2026-06-23 18:40:22] 起動: /home/wp498612/.nodebrew/current/bin/npm run import-llm-list

> muemo-data@0.1.0 import-llm-list
> tsx src/pipeline/import_llm_list.ts

[2026-06-23T09:40:22.812Z] INFO import_llm_list 開始 {"path":"data/staging/bunka-llm-filled.jsonl","lines":1428,"dryRun":false}
[2026-06-23T09:40:23.322Z] INFO import_llm_list: 値棄却 {"source_key":"181","field":"description","reason":"説明が短すぎる"}
[2026-06-23T09:40:24.744Z] INFO import_llm_list: 値棄却 {"source_key":"563","field":"description","reason":"説明が短すぎる"}
[2026-06-23T09:40:25.777Z] INFO import_llm_list: 値棄却 {"source_key":"759","field":"description","reason":"説明が短すぎる"}
[2026-06-23T09:40:30.241Z] INFO import_llm_list 完了 {"lines":1428,"notFound":0,"filledCols":2823,"rejected":3,"approved":931,"needsReview":482}