python script to automize data file upload to existing table appending the data

Public Clarification Board

• 

  ashikmohann

  • 2 years ago

  hi, the script should be scheduled to run weekly?

  • 2 years ago
  1. 
     Contest Holder

     • 2 years ago

     Yes

     • 2 years ago
• 

  AVKor

  • 2 years ago

  Hi, #extended please and upload a samples of your files (what you are going to get from your FTP server and your database schema).

  • 2 years ago
  View 1 more message
  1. 

     AVKor

     • 2 years ago

     In this case it will be useless to you since the structure, data types, database schema and so on will be not the same as you have and could not be used for your dataset. But if you are going to rewrite the script yourself for your own needs that's OK.

     • 2 years ago
  2. 
     Contest Holder

     • 2 years ago

     Yes I will edit all the schemas and additional details
     We are looking to see who can provide python script that would extract - load the files to BigQuery
     You can use a very simple csv file with few columns...
     Just looking to see how the logic is created to automize the process
     
     Thank you

     • 2 years ago
• 
  Contest Holder

  • 2 years ago

  Please not I am specifically looking for a python script

  • 2 years ago
• 

  samiul92

  • 2 years ago

  Hi, I am creating a program for you. So I need to know that from which source of FTP(Any Database like Oracle Database/MS SQL/MySQL or Just like Excel Sheet) to extract data and Load into which Database?

  • 2 years ago
  View 1 more message
  1. 
     Contest Holder

     • 2 years ago

     Load into Big Query SQL

     • 2 years ago
  2. 

     samiul92

     • 2 years ago

     Ok, Thanks for answer

     • 2 years ago

Show more comments