SQL

From Александр Юрьевич Храмов, 4 Months ago, written in Plain Text, viewed 83 times.
URL http://codebin.org/view/5f17eff4 Embed
Download Paste or View Raw
  1. import numpy as np
  2. import pandas as pd
  3. from pyspark.sql import SparkSession
  4.  
  5. APP_NAME = "DataFrames"
  6. SPARK_URL = "local[*]"
  7.  
  8. spark = SparkSession.builder.appName(APP_NAME) \
  9.         .config('spark.ui.showConsoleProgress', 'false') \
  10.         .getOrCreate()
  11.  
  12. taxi = spark.read.load('/datasets/pickups_terminal_5.csv',
  13.                        format='csv', header='true', inferSchema='true')
  14.  
  15. taxi_select = taxi[['date','hour', 'minute']]# < напишите код здесь >
  16. taxi_select.show(5)

Reply to "SQL"

Here you can reply to the paste above