Closed

Data extraction/load/transformation from jira using python scripting

Project requirements:

I am working on a pilot project in which I need to extract/pull data from Atlassian Jira at project and scrum team level using Atlassian Jira rest api. I have already build a script to pull the data for projects and different scrum

teams using Jira's Rest API. However I found that I am unable to extract all the data using rest api call, meaning even after specifying the limit (using [login to view URL] , limit=say 50000) , the script is able to load data for only first page say

2000 records. I need help in creating a function in python which can iterate for all the pages and return the final result. (meaning all the rows for the filters specified within [login to view URL]). Im basically normalizing

the json data and converting it to a dataframe.

I need help with standardizing the existing piece of work using python script (meaning using the standard script best practices ) which can be automated/scheduled.

Through my script I am able to extract and load the data to MS-SQL, but I am looking for a more robust solution in terms of python scripting best practise (for eg using various functions in the main script for error handling, etc)

Skills I think is necessary : Python scripting, Pandas, Atlassian-python package, Python ETL with MS-SQL.

Skills: Python, Software Architecture, Web Scraping, Elasticsearch, Data Mining

See more: data extraction using regex, data extraction using java, extracting data webpages using python, jira etl, python etl tutorial, pandas etl, python data pipeline framework, python etl pipeline example, get data from jira using python, python data pipeline example, python etl testing framework, python data extraction, data extraction using vba, python script data extraction csv, stx etx read rfid data using python, extracting data web pages using python, extract data html using python, data extraction using api, data extraction website using java, web data extraction python

About the Employer:
( 0 reviews ) Santa Clara, United States

Project ID: #27789187

3 freelancers are bidding on average $25 for this job

sagarbhalkedata6

github: [login to view URL] Hi I am a senior ML & AI developer. I have read your requirement very carefully. I have 2+ years of ML & AI development and get a lot of experience. My main sk More

$20 USD in 7 days
(12 Reviews)
4.3
srimanjs

I have good experience on data extraction and conversion from one db to other and have good knowledge on sql wise

$20 USD in 7 days
(0 Reviews)
0.0
ArshadAyub1236

Hi this is sirajuddin syed.. From Aaro IT solutions.  [login to view URL] Aaro IT solutions  is a premier global company in the IT industry. We are having 7 years of experience in developing business solutions fo More

$35 USD in 1 day
(0 Reviews)
0.0