\r\n| 6<\/td>\r\n | EX-101.SCH<\/td>\r\n | XBRL TAXONOMY EXTENSION SCHEMA<\/td>\r\n | stx-20170331.xsd<\/td>\r\n<\/tr>\r\n<\/tbody><\/table>\r\n\r\n And just for example, here's the end of the full list – note the excel that\r\nisn't on the SEC site for instance.<\/p>\r\n\r\n knitr::kable(tail(parsed_docs[,c("SEQUENCE", "TYPE", "DESCRIPTION", "FILENAME")]),\r\n col.names=c("Sequence", "Type", "Description", "Document"),\r\n digits = 2,\r\n format.args = list(big.mark=","))\r\n<\/code><\/pre>\r\n\r\n\r\n\r\n| <\/th>\r\n | Sequence<\/th>\r\n | Type<\/th>\r\n | Description<\/th>\r\n | Document<\/th>\r\n<\/tr>\r\n<\/thead> | \r\n\r\n| 75<\/td>\r\n | 75<\/td>\r\n | XML<\/td>\r\n | IDEA: XBRL DOCUMENT<\/td>\r\n | R65.htm<\/td>\r\n<\/tr>\r\n | \r\n| 76<\/td>\r\n | 76<\/td>\r\n | EXCEL<\/td>\r\n | IDEA: XBRL DOCUMENT<\/td>\r\n | Financial_Report.xlsx<\/td>\r\n<\/tr>\r\n | \r\n| 77<\/td>\r\n | 77<\/td>\r\n | XML<\/td>\r\n | IDEA: XBRL DOCUMENT<\/td>\r\n | Show.js<\/td>\r\n<\/tr>\r\n | \r\n| 78<\/td>\r\n | 78<\/td>\r\n | XML<\/td>\r\n | IDEA: XBRL DOCUMENT<\/td>\r\n | report.css<\/td>\r\n<\/tr>\r\n | \r\n| 79<\/td>\r\n | 80<\/td>\r\n | XML<\/td>\r\n | IDEA: XBRL DOCUMENT<\/td>\r\n | FilingSummary.xml<\/td>\r\n<\/tr>\r\n | \r\n| 80<\/td>\r\n | 82<\/td>\r\n | ZIP<\/td>\r\n | IDEA: XBRL DOCUMENT<\/td>\r\n | 0001193125-17-148855-xbrl.zip<\/td>\r\n<\/tr>\r\n<\/tbody><\/table>\r\n\r\n The 10-Q Filing document is Seq. 1, with the full text of the document in the\r\nTEXT column.<\/p>\r\n\r\n # NOTE: the filing document is not always #1, so it is a good idea to also look\r\n# at the type & Description\r\nfiling_doc <- parsed_docs[parsed_docs$TYPE == '10-Q' &\r\n parsed_docs$DESCRIPTION == '10-Q', 'TEXT']\r\nsubstr(filing_doc,1,80)\r\n#> [1] "<HTML><HEAD>\\n<TITLE>10-Q<\/TITLE>\\n<\/HEAD>\\n <BODY BGCOLOR=\\"WHITE\\">\\n<h5 align=\\"left"\r\n<\/code><\/pre>\r\n\r\nWe can see that contains the raw document. For document types which are not plain text, e.g. the XBRL zip file, the content is uuencoded and would been further processing.<\/p>\r\n\r\n Parse the Filing Document<\/h2>\r\n\r\nFortunately edgaWebR functions that take URL's will also take a string containing the document, so to parse the document, while we could have passed the URL to the online document we can just pass in the full string.<\/p>\r\n\r\n doc <- parse_filing(filing_doc, include.raw = TRUE)\r\nunique(doc$part.name)\r\n#> [1] "" "PART I" "PART II"\r\nunique(doc$item.name)\r\n#> [1] "" \r\n#> [2] "ITEM 1.\\nFINANCIAL STATEMENTS" \r\n#> [3] "ITEM 2.\\nMANAGEMENT\\u0092S DISCUSSION AND ANALYSIS OF FINANCIAL CONDITION AND RESULTS OF OPERATIONS"\r\n#> [4] "ITEM 3.\\nQUANTITATIVE AND QUALITATIVE DISCLOSURES ABOUT MARKET RISK" \r\n#> [5] "ITEM 4.\\nCONTROLS AND PROCEDURES" \r\n#> [6] "ITEM 1.\\nLEGAL PROCEEDINGS" \r\n#> [7] "ITEM 1A.\\nRISK FACTORS" \r\n#> [8] "ITEM 2.\\nUNREGISTERED SALES OF EQUITY SECURITIES AND USE OF PROCEEDS" \r\n#> [9] "ITEM 3.\\nDEFAULTS UPON SENIOR SECURITIES" \r\n#> [10] "ITEM 4.\\nMINE SAFETY DISCLOSURES" \r\n#> [11] "ITEM 5.\\nOTHER INFORMATION" \r\n#> [12] "ITEM 6.\\nEXHIBITS"\r\nhead(doc[grepl("market risk", doc$item.name, ignore.case=TRUE),"text"], 3)\r\n#> [1] "ITEM\u00a03.\\nQUANTITATIVE AND QUALITATIVE DISCLOSURES ABOUT MARKET RISK" \r\n#> [2] "We have exposure to market\\nrisks due to the volatility of interest rates, foreign currency exchange rates, equity and bond markets. A portion of these risks are hedged, but fluctuations could impact our results of operations, financial position and cash flows. Additionally,\\nwe have exposure to downgrades in the credit ratings of our counterparties as well as exposure related to our credit rating changes." \r\n#> [3] "Interest Rate Risk.\u00a0Our exposure to market risk for changes in interest rates relates primarily to our investment portfolio. As of\\nMarch\u00a031, 2017, we had no material available-for-sale securities that had been in a continuous unrealized loss position for a period greater than 12\u00a0months. We\\ndetermined no available-for-sale securities were other-than-temporarily impaired as of March\u00a031, 2017. We currently do not use derivative financial instruments in\\nour investment portfolio."\r\nrisks <- doc[grepl("market risk", doc$item.name, ignore.case=TRUE),"raw"]\r\n<\/code><\/pre>\r\n\r\nNow the document is all ready for whatever further processing we want. As a\r\nquick example we'll pull out all the italicized risks.<\/p>\r\n\r\n risks <- risks[grep('<i>',risks)]\r\nrisks <- gsub("^.*<i>|<\/i>.*$", "", risks)\r\nrisks <- gsub("\\n", " ", risks)\r\nrisks\r\n#> [1] "Interest Rate Risk" "Foreign Currency Exchange Risk"\r\n#> [3] "Derivatives and Hedging." "Other Market Risks"\r\n<\/code><\/pre>\r\n\r\nThis is a fairly simplistic example, but should serve as a good tutorial on\r\nprocessing filings.<\/p>\r\n\r\n How to Download<\/h2>\r\n\r\nedgarWebR is available from CRAN, so can be simply installed via<\/p>\r\n\r\n install.packages("edgarWebR")\r\n<\/code><\/pre>\r\n\r\nIf you want the latest and greatest, you can get a copy of the development version\r\nfrom github by using devtools:<\/p>\r\n\r\n # install.packages("devtools")\r\ndevtools::install_github("mwaldstein\/edgarWebR")\r\n<\/code><\/pre>","protected":false},"excerpt":{"rendered":"New to edgarWebR 0.2.0 are funtions for parsing SEC documents. While there are good R packages for XBRL processing, there is a gap in extracting information from other document types available via the site. edgarWebR currently provides functions for 2 of those – parse_submission() – Processes a raw SGML filing into component documents parse_filing() – … Continue reading “Parsing Functions in edgarWebR”<\/span><\/a><\/p>","protected":false},"author":1,"featured_media":453,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[16],"tags":[],"class_list":["post-450","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-rstats","no-wpautop"],"_links":{"self":[{"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/posts\/450","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/comments?post=450"}],"version-history":[{"count":2,"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/posts\/450\/revisions"}],"predecessor-version":[{"id":454,"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/posts\/450\/revisions\/454"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/media\/453"}],"wp:attachment":[{"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/media?parent=450"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/categories?post=450"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/micah.waldste.in\/blog\/wp-json\/wp\/v2\/tags?post=450"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
|
|