- Franklin Powers' Ortingo →
- Simple Data Toolkit - Tutorial - GUI - Python Script
Simple Data Toolkit - Tutorial - GUI - Python Script
July 12, 2022 at 5:10 PM UTC
This post has no media.
Franklin Powers
Let's suppose you want to create a task that loads a TSV file into a CSV file on a daily basis. This task is meant to be part of a Python script, but you are unfamiliar with Python and are unsure of how to write the code. Good news, you can use the Sample Data Toolkit UI to figure out this code for you as follows:
1) Go to the app page for the Simple Data Toolkit UI, at the time of this writing it is here: https://www.vis-software.com/#sdtk
2) Click Choose Files.
3) Find the file you want to convert.
4) Click Open.
5) Select the output type you want, for this tutorial we will select SQL.
6) Then for script, select Python.
7) Then click Download Script.
You will now have a simple Python script that uses SDTK to convert the file you selected to CSV. You can now either run this script or integrate it with another one.
If you need to install SDTK for Python, you can do it like so on the terminal/commandline prompt with the following command: pip install sdtk-visllc
The script will look something like this:
from sdtk import com_sdtk_table_Converter as sdtk
sdtk.start().readFile("complex.csv").tsv().textOnly().output().writeFile("complex.csv").csv().execute();
Check out these similar posts and Ortingos?
Simple Data Toolkit - Tutorial - GUI - JavaLet's suppose you want to create a task that loads a TSV file into a PSV file on a daily basis. This task is meant to be part of Java code, but you are unfamiliar with Java and are unsure of how to write the code. Good news, you can use the Sample Data Toolkit UI to figure out this code for you as follows: 1) Go to the app page for the Simple Data Toolkit UI, at the time of this writing it is here: https://www.vis-software.com/#sdtk 2) Click Choose Files. 3) Find the file you want to convert. 4) Click Open. 5) Select the output type you want, for this tutorial we will select PSV. 6) Then for script, select Java. 7) Then click Download Script. You will now have some Java code that uses SDTK to convert the file you selected to PSV. You can now either run this script or integrate it with another one. If you need to install SDTK for Java, you can do it by downloading the latest version from SourceForge and placing it in your class path. At the time of this writing, this can be found here: https://sourceforge.net/projects/simple-data-toolkit/files/0.1.3/sdtk.jar/download The code will look something like this: com.sdtk.table.Converter.start().readFile("complex.csv").tsv().textOnly().output().writeFile("complex.psv").psv().execute();Simple Data Toolkit - Tutorial - PHP - Convert FileLet's suppose you want to create a task that loads a CSV file into an HTML file on a daily basis. This task is meant to be part of a PHP script, but you are unfamiliar with PHP and are unsure of how to write the code. Good news, you can use the Sample Data Toolkit UI to figure out this code for you as follows: 1) Go to the app page for the Simple Data Toolkit UI, at the time of this writing it is here: https://www.vis-software.com/#sdtk 2) Click Choose Files. 3) Find the file you want to convert. 4) Click Open. 5) Select the output type you want, for this tutorial we will select HTMLTable. 6) Then for script, select PHP. 7) Then click Download Script. You will now have a PHP script that uses SDTK to convert the file you selected to an HTML. You can now either run this script or integrate it with another one. If you need to install SDTK for PHP, you can do it by downloading the latest version from SourceForge, unzipping it, and placing it in your include path. At the time of this writing, this can be found here: https://sourceforge.net/projects/simple-data-toolkit/files/0.1.3/sdtk-php.zip/download The script will look something like this: readFile("ga_sample.csv")->csv()->textOnly()->output()->writeFile("ga_sample.htmltable")->htmlTable()->execute(); readfile("ga_sample.htmltable"); ?>Simple Data Toolkit - Tutorial - GUI - Batch ScriptLet's suppose you want to create a task that loads a TSV file into a CSV file on a daily basis. This task is meant to be part of a Batch script, but you are unfamiliar with Batch and are unsure of how to write the code. Good news, you can use the Sample Data Toolkit UI to figure out this code for you as follows: 1) Go to the app page for the Simple Data Toolkit UI, at the time of this writing it is here: https://www.vis-software.com/#sdtk 2) Click Choose Files. 3) Find the file you want to convert. 4) Click Open. 5) Select the output type you want, for this tutorial we will select CSV. 6) Then for script, select Batch. 7) Then click Download Script. You will now have a simple Batch script that uses STC (Simple Table Converter - A commandline utility that is part of the SDTK) to convert the file you selected to CSV. You can now either run this script or integrate it with another one. If you need to install STC, you can install it via Chocolatey (https://chocolatey.org/) with the following command: choco install stc The script will look something like this: stc "ga_sample.csv" textonly "ga_sample.csv"Simple Data Toolkit - Tutorial - Windows - Scheduled TaskLet's suppose you want to create a task that loads a Pipe Delimited File into a database on a daily basis. The task is to run on Windows and you are using Snowflake for the database. You can do it with SDTK as follows: 1) Download SDTK. For this tutorial, we're going to use the latest version of the Windows Shell Script version as of this writing (0.1.2) which is here: https://sourceforge.net/projects/simple-data-toolkit/files/0.1.3/stc-wsh.js/download 2) Create a new text file called ConvertPSV.cmd 3) Open the file with a text editor (like Notepad or Visual Studio Code) Enter the following text: cscript stc-wsh.js clients.psv clients.sql createorreplace clients (For more info on STC and SDTK see the following URL: https://www.vis-software.com/#sdtk) (For more info on cscript see the following URL: https://docs.microsoft.com/en-us/windows-server/administration/windows-commands/cscript) SET SNOWSQL_PWD=password snowsql -a myorganization-myaccount -u jsmith -f clients.sql -d database -s public -o quiet=true -o friendly=false (For more info on snowsql see the following URL: https://docs.snowflake.com/en/user-guide/snowsql-use.html) 4) Go to the Start Menu. 5) Search for Task Scheduler. (For more info on Task Scheduler see the following URL: https://docs.microsoft.com/en-us/windows/win32/taskschd/about-the-task-scheduler) 6) Open Task Scheduler. 7) Click Create Task. 8) For name enter: Convert PSV to SQL 9) Click Triggers Tab 10) Click New button 11) Select Daily 12) Start start time to 8:00 AM. 13) Click the OK button. 14) Click Actions tab. 15) Click New button 16) For Program/script click Browse. 17) Find the ConvertPSV.cmd script. 18) Click Open. 19) Set Start in to the directory that the ConvertPSV.cmd script is in. 20) Click the OK button. 21) Click the OK button. 22) To test, right click Convert PSV to SQL. 23) Select Run.Simple Data Toolkit - Tutorial - Mac OS - Scheduled TaskLet's suppose you want to create a task that loads a Pipe Delimited File into a database on a daily basis. The task is to run on Mac OS and you are using Snowflake for the database. You can do it with SDTK as follows: 1) Download SDTK. For this tutorial, we're going to use the latest version of the Python version as of this writing (0.1.2) which is here: https://sourceforge.net/projects/simple-data-toolkit/files/0.1.3/stc.py/download 2) Create a new text file called ConvertPSV.sh 3) Open the file with a text editor (like Text Edit) Enter the following text: #!/bin/sh python stc.py clients.psv clients.sql createorreplace clients (For more info on STC and SDTK see the following URL: https://www.vis-software.com/#sdtk) export SNOWSQL_PWD=password snowsql -a myorganization-myaccount -u jsmith -f clients.sql -d database -s public -o quiet=true -o friendly=false (For more info on snowsql see the following URL: https://docs.snowflake.com/en/user-guide/snowsql-use.html) 4) Go to the Terminal. 5) Edit the list of cron jobs with the following command: nano crontab -e 6) Add the following to a new line: 0 8 * * * cd ~ && ConvertPSV.sh 7) Press CTRL+O and CTRL+X to save and exit nano.Simple Data Toolkit - Tutorial - Linux - Scheduled TaskLet's suppose you want to create a task that loads a Pipe Delimited File into a database on a daily basis. The task is to run on Linux and you are using Snowflake for the database. You can do it with SDTK as follows: 1) Download SDTK. For this tutorial, we're going to use the latest version of the Python version as of this writing (0.1.2) which is here: https://sourceforge.net/projects/simple-data-toolkit/files/0.1.3/stc.py/download 2) Create a new text file called ConvertPSV.sh 3) Open the file with a text editor (like Text Edit) Enter the following text: #!/bin/sh python stc.py clients.psv clients.sql createorreplace clients (For more info on STC and SDTK see the following URL: https://www.vis-software.com/#sdtk) export SNOWSQL_PWD=password snowsql -a myorganization-myaccount -u jsmith -f clients.sql -d database -s public -o quiet=true -o friendly=false (For more info on snowsql see the following URL: https://docs.snowflake.com/en/user-guide/snowsql-use.html) 4) Go to the Terminal. 5) Edit the list of cron jobs with the following command: nano crontab -e 6) Add the following to a new line: 0 8 * * * cd ~ && ConvertPSV.sh 7) Press CTRL+O and CTRL+X to save and exit nano.Atotium News - Business Aggregate - 2024-11-18Title: 401(k) Managed Accounts Are an Underutilized Resource URL: https://www.aaii.com/journal/article/233462-401k-managed-accounts-are-an-underutilized-resource Summary: A study conducted by Cerulli Associates, sponsored by Edelman Financial Engines, reveals the benefits and underutilization of 401(k) managed accounts among retirement plan participants. The study found that participants in managed account programs are nearly three times more confident in their retirement investing strategy. Despite these benefits, only 8% of participants use managed accounts, with a majority unable to correctly define them. The researchers suggest that improved communication and framing these accounts as employee benefits, along with promoting human advisor interactions, could increase adoption rates and enhance the financial well-being of 401(k) participants. Title: Using Bond Ladders and Income Annuities for Retirement Income URL: https://www.aaii.com/journal/article/13928-using-bond-ladders-and-income-annuities-for-retirement-income Summary: The article by Aaron Brask discusses two financial tools—bond ladders and income annuities—that retirees can use to generate stable cash flows and manage risks associated with retirement. It critiques the conventional total-return investing strategy, emphasizing that fixed-income investments like bonds can offer less risky, stable cash flows when held to maturity. Bond ladders are recommended for their simplicity and passive income features, while income annuities are highlighted for their ability to pool longevity risks across individuals, thereby enabling more efficient retirement funding. The article also addresses misconceptions around annuities, detailing their competitiveness and benefits in securing guaranteed lifetime income. Overall, both tools provide retirees with options to structure effective retirement income strategies while minimizing market volatility and actuarial risks. Title: So You Have Decided to Buy Bonds. Here Are Six Charts Showing Your Options. URL: https://www.wsj.com/finance/investing/so-you-have-decided-to-buy-bonds-here-are-six-charts-showing-your-options-d55078fa Summary: The article explores various options for investors considering bonds in the current economic climate. With Treasury bonds becoming more expensive and offering limited potential for capital gains, shifting strategies is advised. Long-term Treasurys have historically delivered better returns during easing cycles, despite risks of price fluctuations. For those looking into corporate debt, although investment-grade bonds offer marginal spreads over Treasurys, opportunities exist, particularly in consumer noncyclical sectors with higher yields. CLOs, mortgage-backed securities, and emerging-market debt present additional options, each with unique risk profiles and benefits. Additionally, dividend-paying equities can serve as a bond proxy, blending income with a level of risk more akin to bonds, a strategy that has delivered competitive returns historically even amid market volatility post-pandemic. Title: IBM Releases AI Models for Businesses URL: https://finance.yahoo.com/news/ibm-releases-ai-models-businesses-040820671.html Summary: IBM unveiled its latest "Granite 3.0" AI models, designed for business use, aiming to tap into the growing market for generative AI technology. By offering these models as open-source, IBM stands apart from competitors like Microsoft which charge for model access. IBM provides a paid service called Watsonx to help businesses run customized models in their data centers. Some Granite models are available for commercial use on Watsonx and Nvidia's software tools. The models were developed using Nvidia's H100 GPUs. Title: Angel Investing Isn't What It Used to Be URL: https://www.wsj.com/articles/angel-investing-isnt-what-it-used-to-be-e643c862 Summary: This article discusses how the landscape of angel investing has changed over the years, primarily due to the increased involvement of venture capital firms at early stages of investments. Angel investing, once a domain for individual investors supporting nascent startups, is now less appealing as venture firms, tech giants, and new entrants like hedge funds compete heavily in this space. This competition has driven up valuations and round sizes, making it tough for angels to secure prime deals. The value of angel deals in the U.S. has sharply decreased over recent years. Many angels are becoming limited partners in venture funds to diversify, while those with strong credentials and network connections still find opportunities. The rise of accelerator programs has also shifted the dynamics, offering startups institutional capital that diminishes their reliance on angel investors. Title: Treasuries Plunge Like It's 1995 as Traders See Soft Landing URL: https://finance.yahoo.com/news/treasuries-plunge-1995-traders-see-154428389.html Summary: The US Treasury market is experiencing its biggest selloff since 1995, as two-year yields have increased by 34 basis points following the Federal Reserve's first rate cut since 2020. This trend reflects a reduced probability of recession and strong economic data, prompting speculation that the Fed might slow its pace of rate cuts. Rising yields are influenced by the resilient US economy and financial markets' impact on the Fed's rate-cutting options. Additionally, market volatility and political concerns about potential Republican control of the government further contribute to rising yields. The market activity mirrors a similar situation in 1995 when then-Fed Chair Alan Greenspan achieved an economic soft landing.Atotium News - Business Aggregate - 2024-12-10Federal Reserve to cut rates by 25 bps on Dec. 18, pause in January- Reuters poll https://finance.yahoo.com/news/federal-cut-rates-25-bps-135054884.html The U.S. Federal Reserve is expected to cut interest rates by 25 basis points on December 18, with 90% of economists polled by Reuters predicting this move. Following this, a pause in rate changes is anticipated in late January amidst concerns over rising inflation risks. Economists attribute potential inflationary pressures to President-elect Donald Trump's proposed policies, including import tariffs and tax cuts. The job market's resilience has reinforced expectations for a rate cut, with most economists forecasting the federal funds rate to be reduced to 4.25%-4.50%. However, a majority expect the Fed to hold rates steady at its January meeting. While nearly 60% of economists predict at least three more rate cuts next year, there is no consensus on future actions. The Fed aims to reach a neutral rate that neither stimulates nor restricts the economy, recently assessed at around 2.9%. Inflation forecasts have been elevated, with concerns about inflation risks due to increased tariffs and potential trade disruptions from the incoming administration. The Fed will update its economic forecasts at the December meeting. GM exits robotaxi market, will bring Cruise operations in house https://www.cnbc.com/2024/12/10/gm-halts-funding-of-robotaxi-development-by-cruise.html General Motors (GM) has decided to end its funding for the development of robotaxis by its subsidiary Cruise. Instead, GM plans to integrate Cruise into its larger technical team to focus on developing autonomous systems for personal vehicles. This decision, announced after an investment of over $10 billion in Cruise, is attributed to the competitive robotaxi market, capital allocation priorities, and the extensive time and resources required to scale up. GM bought Cruise in 2016 and plans to increase its ownership to over 97% by early 2025. This move will also reduce Cruise's annual expenditure from about $2 billion by more than half. Cruise, which halted its driverless operations in October 2023, faced regulatory issues including a crash involving a pedestrian and internal problems that contributed to the decision. GM's departure from the robotaxi market occurs as competitors like Waymo, Tesla, and others advance their own autonomous vehicle services. Microsoft Unveils Zero-Water Data Centers to Reduce AI Climate Impact https://finance.yahoo.com/news/microsoft-unveils-zero-water-data-170002064.html Microsoft has introduced a new data center design that requires zero water for cooling its chips and servers, aimed at reducing the climate impact of its expanding data center operations. This new system employs a "closed loop" method, recycling water that is initially introduced during construction without needing fresh supplies afterward. This initiative, launched in August, is expected to save over 125 million liters of water per year per data center. While the data centers will still need fresh water for facilities like bathrooms and kitchens, this new design is part of Microsoft s effort to address the environmental demands of its growing AI services, particularly in hot and dry regions such as Arizona and Texas. Existing data centers will maintain older technologies, but new facilities in Phoenix and Mount Pleasant, Wisconsin, will adopt this zero-water design starting in 2026. Crypto Trading Frenzy Leads Analyst to Hike Price Targets for Coinbase, Robinhood Stock https://www.barrons.com/articles/crypto-coinbase-robinhood-stock-price-target-71f031b2 The article discusses a recent surge in crypto trading activity, prompting an analyst from Needham & Co., John Todaro, to raise price targets for Coinbase and Robinhood. Despite previous muted trading volumes, both platforms are experiencing increased activity. Todaro increased his target for Coinbase to $420 and for Robinhood to $52, while maintaining a Buy rating. The appointment of Donald Trump and his regulatory policy changes favoring the crypto industry are seen as beneficial for these companies. SEC leadership changes and Trump's pro-crypto stance are expected to promote new products and trading on these platforms, with Robinhood aiming to be a leader in crypto and options trading by 2027 and equities by 2029. Bitcoin has reached record highs, motivating a resurgence in trading activity after a period of relative quiet.Simple Data Toolkit - Tutorial - Git API - PythonSimple Data Toolkit provides an unofficial API for reading files, commits, branches, and repos from the Git API. (At the time of this writing, the release of this is pending for complete support, but it is coming soon) To retrieve all repos a user has using Simple Data Toolkit, we can do the following:
from sdtk import com_sdtk_api_GitAPI
def printer(data, reader):
print(reader.toArrayOfNativeMaps(None))
com_sdtk_api_GitAPI.reposAPI().retrieveData({"owner": "Vis-LLC"}, printer)
To retrieve all branches a repo has using Simple Data Toolkit, we can do the following:
from sdtk import com_sdtk_api_GitAPI
def printer(data, reader):
print(reader.toArrayOfNativeMaps(None))
com_sdtk_api_GitAPI.branchesAPI().retrieveData({"owner": "Vis-LLC", "repo": "Simple-Data-Toolkit"}, printer)
To retrieve all the files in a branch using Simple Data Toolkit, we can do the following:
from sdtk import com_sdtk_api_GitAPI
def printer(data, reader):
print(reader.toArrayOfNativeMaps(None))
com_sdtk_api_GitAPI.filesAPI().retrieveData({"owner": "Vis-LLC", "repo": "Simple-Data-Toolkit", "branch": "main"}, printer)
To retrieve the data in a file using Simple Data Toolkit, we can do the following:
from sdtk import com_sdtk_api_GitAPI
def printerData(data, reader):
print(data)
com_sdtk_api_GitAPI.retrieveAPI().retrieveData({"owner": "Vis-LLC", "repo": "Simple-Data-Toolkit-UI", "branch": "main", "path": "index.html"}, printerData)
We can also login using a personal access token (https://docs.github.com/en/authentication/keeping-your-account-and-data-secure/managing-your-personal-access-tokens)
from sdtk import com_sdtk_api_GitAPI
def printerData(data, reader):
print(data)
com_sdtk_api_GitAPI.instance().setKey("Personal Access Token Here").retrieveAPI().retrieveData({"owner": "Vis-LLC", "repo": "Simple-Data-Toolkit-UI", "branch": "main", "path": "index.html"}, printerData)
Atotium News - Business Aggregate - 2024-11-17Title: Bosses Are Calling Workers Back to the Office. That’s Good News for Landlords.
URL: https://www.wsj.com/real-estate/commercial/back-to-office-workers-landlords-e5e15663
Summary: Companies are increasingly requiring employees to return to the office, reversing the trend of remote work during the pandemic. As a result, the office market is showing signs of stabilization, with investor interest growing in office properties, especially those with amenities. Despite the challenges of high vacancy rates and obsolete spaces, the amount of occupied office space remains steady. Some companies, like Amazon and Dell, are mandating five-day office attendance, shifting power back to managers as the white-collar workforce growth slows. The stabilization, however, doesn't equate to a full recovery due to ongoing defaults and expected space reductions when leases mature. Yet, certain markets are thriving with expansion from financial and AI firms. Enhanced office amenities are drawing employees back, boosting investor confidence and leading to significant financing deals, notably the refinancing of Rockefeller Center by Tishman Speyer.
Title: Deficit Threat Drives Bond Yields Higher
URL: https://www.wsj.com/finance/investing/deficit-threat-drives-bond-yields-higher-6a043d44
Summary: The article discusses how concerns over a rising federal budget deficit are causing a significant increase in bond yields, especially following a recent lackluster auction of government bonds. Investors anticipate sustained high deficits regardless of the upcoming election outcome, though they expect the deficit to expand most under a Republican victory due to potential tax cuts. The Treasury Department is likely to maintain its high level of debt sales, with potential for further increases. As longer-term Treasury yields rise in reaction to increased bond supply fears, analysts are watching upcoming Treasury borrowing announcements for signals on future auction plans. The fiscal year 2025 deficit projection stands near $2 trillion, with election results potentially affecting future fiscal conditions.
Title: Your Billy Bookcase Should Have Multiple Lives, Says IKEA Sustainability Chief
URL: https://www.wsj.com/articles/your-billy-bookcase-should-have-multiple-lives-says-ikea-sustainability-chief-f30b24e8
Summary: IKEA's sustainability efforts, led by Ingka Group's Chief Sustainability Officer Karen Pflug, focus on achieving net-zero emissions by 2050 without carbon offsets. A key initiative is the testing of Ikea Preowned, a platform in Madrid and Oslo for buying and selling secondhand IKEA furniture, which they hope to expand globally. The company aims to use renewable or recycled materials across its products while promoting circularity, encouraging customers to extend product lifecycles. Efforts include the provision of spare parts and a peer-to-peer marketplace, reflecting IKEA's commitment to sustainability without compromising product quality.
Title: Used EVs Sell for Bargain Prices Now, Putting Owners and Dealers in a Bind
URL: https://www.wsj.com/business/autos/used-evs-sell-for-bargain-prices-now-putting-owners-and-dealers-in-a-bind-a44e1718
Summary: The value of used electric vehicles (EVs) has dropped significantly, contrasting with the stable broader used-car market. This decline follows price cuts on new EVs, particularly led by Tesla, aimed at boosting sales but negatively impacting used EV values. Previously, in-demand models like the Tesla Model 3 and Model Y have seen a 25% price drop. Factors contributing to this dip include the influx of off-loaded Teslas from rental company Hertz and competitive lease deals on new models. The plummeting prices present challenges for current owners who find themselves owing more than their cars are worth and potential long-term concerns for the industry as leasing rises sharply.
Title: Retail giant buys properties near DIA for $91M
URL: https://www.bizjournals.com/denver/news/2024/09/30/amazon-aurora-porteos-dia-ambrose-property-group.html
Summary: Amazon has acquired a warehouse and additional land in Aurora, Colorado, near Denver International Airport, for over $91 million. The purchases include a 625,000-square-foot building within a larger industrial development known as DIA Logistics Park, and a separate parcel of vacant land. These acquisitions expand Amazon's footprint in the region, benefitting from a location that already hosts several of the company's facilities.
Title: The US retirement system gets a C+ in global study
URL: https://finance.yahoo.com/news/the-us-retirement-system-gets-a-c-in-global-study-230119976.html
Summary: The US retirement system received a C+ in the 16th annual Mercer CFA Institute Global Pension Index, placing 29th out of 48 countries. The evaluation highlighted concerns regarding pension funding and insufficient private retirement savings, exacerbated by declining birth rates and increasing life expectancy. The US scored a C+ for adequacy and Cs for sustainability and integrity. The report suggests incorporating automatic enrollment and contribution escalation to improve the system, taking cues from countries like the Netherlands, which have successful retirement systems. The Secure 2.0 Act, which mandates automatic enrollment and escalation for new retirement plans starting in 2025, could help address some of these issues.Simple Data Toolkit - Python - Loading Images Through ChatGPTSimple Data Toolkit provides an API for passing images to ChatGPT and extracting related text. (At the time of this writing, the release of this is pending for complete support, but it is coming soon)
To generate a LaTeX document based on a series of images (effectively doing OCR) we can do the following:
from sdtk import com_sdtk_api_ChatGPTAPI
import os
import fnmatch
import re
texData = ""
texBegin = "\n\\begin{document}\n"
texEnd = "\n\\end{document}"
header = ""
footer = ""
foundBody = False
# Get a list of all .png files in the current directory
png_files = [file for file in os.listdir('.') if fnmatch.fnmatch(file, '*.png')]
def result(text):
global texData
global header
global footer
global foundBody
text = text.replace("```latex", "").replace("```", "")
body_match = re.search(r'\\begin{document}(.*?)\\end{document}', text, re.DOTALL)
if body_match:
body_content = body_match.group(1).strip()
if len(texData) > 0:
texData = texData + "\n" + "\\newpage" + "\n"
else:
header_match = re.search(r'^(.*?)\\begin{document}', text, re.DOTALL)
header = header_match.group(1).strip()
footer_match = re.search(r'\\end{document}(.*)$', text, re.DOTALL)
footer = footer_match.group(1).strip()
texData = texData + body_content
foundBody = True
else:
foundBody = False
print(text)
# Loop over each .png file
for file_name in png_files:
foundBody = False
while foundBody == False:
com_sdtk_api_ChatGPTAPI.instance().query(result, "Can you generate a LaTeX document to represent the text in this image and format it correctly and return only the LaTeX code?", file_name)
with open("output.tex", "w+") as file:
# Write the string to the file
file.write(header + texBegin + texData + texEnd + footer)
Simple Data Toolkit - Tutorial - Ortingo API - PythonAt the time of this writing, Ortingo does not have an official API. Fortunately, Simple Data Toolkit provides an unofficial API for reading posts (at the time of this writing, the release of this is pending for complete support, but it is coming soon)
To retrieve all posts for a given user in Python, using Simple Data Toolkit, we can do the following:
from sdtk import com_sdtk_api_OrtingoAPI
def printer(data, reader):
print(reader.toArrayOfNativeMaps(None))
com_sdtk_api_OrtingoAPI.postsAPI().retrieveData({"owner": "60CQ59FN46SVQFXJ"}, printer)
Let's suppose we want only a list of titles for a given user, we can do this instead:
from sdtk import com_sdtk_api_OrtingoAPI
def printer(data, reader):
print(reader.filterColumnsOnly(["title"]).toArrayOfNativeMaps(None))
com_sdtk_api_OrtingoAPI.postsAPI().retrieveData({"owner": "60CQ59FN46SVQFXJ"}, printer)
We can also pull suggested content from Ortingo with the following, where the topics we are searching on are provided with the query parameter (in this case it's value is data):
from sdtk import com_sdtk_api_OrtingoAPI
def printerUrls(data, reader):
print(reader.filterColumnsOnly(["url"]).toArrayOfNativeMaps(None))
com_sdtk_api_OrtingoAPI.suggestionsAPI().retrieveData({"query": "data"}, printerUrls)
And finally, we can also pull comments attached to a post in Ortingo with the following, where the user is myself and the post is a test post I created:
from sdtk import com_sdtk_api_OrtingoAPI
def printerComments(data, reader):
print(reader.filterColumnsOnly(["commentDate", "post"]).toArrayOfNativeMaps(None))
com_sdtk_api_OrtingoAPI.commentsAPI().retrieveData({"owner": "60CQ59FN46SVQFXJ", "id": "test"}, printerComments)
The columns supported at the time of this writing are:
- id
- owner
- title
- subtitle
- post
- url
For comments the following columns are supported:
- id
- owner
- commentDate
- replyTo
- post
Write the right way.
Ortingo is a platform that makes publishing easier and information more accessible. Publish from a wide spectrum of various topics and connect with your audience with new ways of writing articles. Be part of a wealth of new information, through Ortingo.
Ready to write the right way?
Learn more about Ortingo
Any thoughts on Franklin's post?
To comment or reply, you need an Ortingo account.
Sign in or sign upHere's what Ortingoers think of Franklin's post.
There are no comments on this post.