\nData accessibility requires Ingesting data to data store and\/or software service.
\n
![\"\"](\"https:\/\/www.sambuichi.jp\/wp-content\/uploads\/2017\/09\/795316b92fc766b0181f6fef074f03fa.png\")
<\/a><\/p>\nTest results for following 3 steps;\u000bData\u3000Preparation, Extraction, and Ingestion<\/h2>\n
Extract time and file size for each file format. Extracted file size differs by file format but these difference has little effect for todays rich IT environment. Difference by file format is negligible for ingesting. Execution time consists mostly of formatting table.<\/p>\n Schema is necessary for ingesting software to verify data and to import data correctly.<\/p>\n CSV: gl_detail_20090401_20090630.csv<\/a> Views: 121preliminary test results of each file format Prepare, Extract, Ingest No one want to read extracted […]<\/p>\n","protected":false},"author":2,"featured_media":2952,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":[],"categories":[32,17],"tags":[],"_links":{"self":[{"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=\/wp\/v2\/posts\/2868"}],"collection":[{"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=2868"}],"version-history":[{"count":10,"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=\/wp\/v2\/posts\/2868\/revisions"}],"predecessor-version":[{"id":2879,"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=\/wp\/v2\/posts\/2868\/revisions\/2879"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=\/wp\/v2\/media\/2952"}],"wp:attachment":[{"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=2868"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=2868"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.sambuichi.jp\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=2868"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}<\/a><\/p>\nExtraction Results<\/h2>\n
\nOne year (12,352 records) of General Ledger entry data of Small Entity. Generated 4 files for each quarter periods.
\n<\/a>
\nThere is difference among each file. XBRL GL took more time and file size.
\nBUT these difference has less importance with today’s IT environment.
\nSoftware is written in PHP
\nHardware Amazon Web Service EC2 Instance
\nModel:t2.small\tvCPU:1\tMemory:2GiB\tStorage EBS-Only
\nmodel name : Intel(R) Xeon(R) CPU E5-2670 v2 @ 2.50GHz cpu MHz : 2500.060 cache size : 25600 KB<\/p>\nIngest Result<\/h2>\n
<\/a>
\nThere is no significant difference among each file
\nStep 1 depends on network speed and file size but it is negligible .
\nStep 2 ~ 3 differs by file format but it is negligible.
\nExecution time consists mostly of Step 4 ~ 5.
\nSoftware is written in Javascript(jQuery) and DataTables library
\nHardware MacBook Pro Processor 2.5GHz Core i5 Memory 8 GB 1600 MHz DDR3<\/p>\nFindings<\/h2>\n
Extract<\/h3>\n
\nExtraction time also differs by file format but we should think total turnaround time including preparation time.<\/p>\nIngest<\/h3>\n
Schema file<\/h3>\n
Each file format<\/h2>\n
\nXBRL GL: gl_detail_20090401_20090630.xml<\/a>
\nJSON-LD: gl_detail_20090401_20090630.json<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"