Closed

Data extraction/load/transformation from jira using python scripting

I am working on a pilot project in which I need to extract/pull data from Atlassian Jira at project and scrum team level using Atlassian Jira rest api. I have already build a script to pull the data for projects and different scrum

teams using Jira's Rest API. However I found that I am unable to extract all the data using rest api call, meaning even after specifying the limit (using [login to view URL] , limit=say 50000) , the script is able to load data for only first page say

2000 records. I need help in creating a function in python which can iterate for all the pages and return the final result. (meaning all the rows for the filters specified within [login to view URL]). Im basically normalizing

the json data and converting it to a dataframe.

I need help with standardizing the existing piece of work using python script (meaning using the standard script best practices ) which can be automated/scheduled.

Through my script I am able to extract and load the data to MS-SQL, but I am looking for a more robust solution in terms of python scripting best practise (for eg using various functions in the main script for error handling, etc)

Skills I think is necessary : Python scripting, Pandas, Atlassian-python package, Python ETL with MS-SQL.

Skills: Python, Web Scraping, Software Architecture, Elasticsearch, Data Mining

See more: data extraction using regex, data extraction using java, extracting data webpages using python, etl scripts, python data pipeline framework, python etl tutorial, pandas etl, python data pipeline example, python etl pipeline example, jira etl, python etl testing framework, python data extraction, data extraction using vba, python script data extraction csv, stx etx read rfid data using python, extracting data web pages using python, extract data html using python, data extraction using api, import data from csv to mysql using python, import data from excel into mysql using python

About the Employer:
( 0 reviews ) Santa Clara, United States

Project ID: #27813274

14 freelancers are bidding on average $178 for this job

schoudhary1553

Hi, Greetings! ✅checked your project details: Data extraction/load/transformation from jira using python scripting ✅Completed Time: In project deadline We have worked on 600 + Projects. I have 6 + years of the More

$220 USD in 4 days
(115 Reviews)
7.1
raminde

Have over 10 years of experience in data mining/ Web scrapping/ Scraping Bots/ Chrome/Opera Extensions I have done it all. Tell us your source and we will put it in excel for you, Or we can even give you filtered resul More

$278 USD in 2 days
(13 Reviews)
6.1
imtyzooel71n

Hi, I am professional Python script developer, I can Data extraction/load/transformation from jira using python scripting by python within very short time. Thanks

$200 USD in 3 days
(40 Reviews)
5.3
igorshapo926

Hello. Nice to meet you. I just checked your requirement carefully and I will surely help you to scrape Jira data I'm very interested in this project and very confidence about your project. I'm senior full-stack web More

$150 USD in 1 day
(8 Reviews)
4.9
viduWEBmaster

Hi there! Are you looking for a machine learning expert ? I have architected multiple AI Systems for various purposes. One of the products is askcupido.com. This system uses multiple AI models concurrently to analys More

$150 USD in 3 days
(4 Reviews)
3.9
romansydorenko07

Hi I am a very experienced , data scientist and software developer. I have worked with data from several companies and have done projects involving high level quantitative analysis and data interpretation skills to stu More

$140 USD in 7 days
(3 Reviews)
3.6
amrafifi73

Hi there. I read your job description carefully and i can do it perfectly. I have much experience for 7+ years in WebScraping Field. I can do your job with php ,crawler,scrapy, BS4, Selenium modules of python. I am con More

$100 USD in 2 days
(3 Reviews)
2.6
regg00

Hi, I can help you with that. I've been working with Python and Jira for a total of 15 years now. I also have at least a year of experience with Pandas. Are you using the cloud or self-hosted version of Jira? I'm aski More

$250 USD in 7 days
(1 Review)
2.5
eyadbas

Dear Sir! I've seriously went through your post and I have understood what you need. I am sure that I can be the best candidate who is able to perfectly complete this project Data extraction/load/transformation from ji More

$155 USD in 2 days
(1 Review)
1.9
zarnishhayaqasim

Hello dear! How are you ? I've 5 years experienced in developing field. And I checked your task description and very interested in this project. Dear Client, I am expertise in php, core php, CMS, HTML5, CSS3, bootst More

$140 USD in 7 days
(0 Reviews)
0.0
sparxsols11

Hello, I am an expert software engineer with 4+ years of experience. I have written a lot of programs in Python and MATLAB, for various domains like ML, signal processing, image processing, basic scripting etc. I have More

$140 USD in 7 days
(0 Reviews)
0.0
nicolasrepetti

Hi, I am a SW engineer witih ten years of experiencien on python and SQL Server. I would like to help you with the project. Regards

$150 USD in 7 days
(0 Reviews)
0.0
sachinjiosy40120

I have came through your requirements. You are looking for extract all data from all pages to ms sql. I have skills in web scraping, python, data mining, pandas, jira api. If I will get your project then I will solve More

$140 USD in 7 days
(0 Reviews)
0.0
shashanksharma55

Certified Aws data engineer having experience in python pyspark sql.. worked in different python lib (pandas, numpy)... Extracted data through api end point and parse it in structured form and then put in csv/parquete/ More

$278 USD in 4 days
(0 Reviews)
0.0