032a_MSR_BeijingTaxiTrajectories_MagellanQueries(Scala)

SDS-2.x, Scalable Data Engineering Science

This is part of Project MEP: Meme Evolution Programme and supported by databricks academic partners program.

Copyright 2016-2019 Dillon George, Dan Lilja and Raazesh Sainudiin

Licensed under the Apache License, Version 2.0 (the "License");
you may not use this file except in compliance with the License.
You may obtain a copy of the License at

    http://www.apache.org/licenses/LICENSE-2.0

Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.

Scalable Spatio-Temporal Constraint Satisfaction Problem (ST-CSP)

Suppose you have base spatial sets in 2D space (points, lines, polygons, etc) given by:

{Si}i=1m\{S_i \}_{i=1}^m

and base temporal sets in 1D given by intervals in time: {Tj}j=1n. \{T_j \}_{j=1}^n .

Then one can obtain space-time set in 3D as unions of Cartesian products of such base spatial and temporal sets.

A simple constraint satisfaction problem can be posed as a Boolean-valued statement involving such space-time sets.

Often, the first seps that a geospatial scientist or analyst needs to take in order to build intuition about the phenomenon of interest invovles such CSP problems.

Some simple examples of such CSP problems are:

  • Given a set of GPS trajectories for multiple entities find the set of entities that intersect with a given space-time set or a collection of space-time sets.
  • Find the set of entitites that were close to one another based on their trajectories during a given period of time.
  • Find entities that are spatio-temporally inconsistent - such as being in two places at the same time.
  • ...

Microsoft Research's Beijing Taxicab Trajectories using Magellan

T-Drive trajectory data sample

Yu Zheng

12 August 2011

Abstract

This is a sample of T-Drive trajectory dataset that contains a one-week trajectories of 10,357 taxis. The total number of points in this dataset is about 15 million and the total distance of the trajectories reaches 9 million kilometers.

Please cite the following papers when using the dataset: [1] Jing Yuan, Yu Zheng, Xing Xie, and Guangzhong Sun. Driving with knowledge from the physical world. In The 17th ACM SIGKDD international conference on Knowledge Discovery and Data mining, KDD'11, New York, NY, USA, 2011. ACM. [2] Jing Yuan, Yu Zheng, Chengyang Zhang, Wenlei Xie, Xing Xie, Guangzhong Sun, and Yan Huang. T-drive: driving directions based on taxi trajectories. In Proceedings of the 18th SIGSPATIAL International Conference on Advances in Geographic Information Systems, GIS '10, pages 99-108, New York, NY, USA,2010. ACM.

More details on the dataset and related papers are available here.

Steps in this notebook

  1. Download the taxi trips in Beijing from MSR.
  2. Turn them into Dataframes.
  3. Define generic functions for the CSP problem.
import org.apache.hadoop.io.BytesWritable
import org.apache.hadoop.io.Text
import org.apache.hadoop.mapreduce.Job
import org.apache.hadoop.io.BytesWritable import org.apache.hadoop.io.Text import org.apache.hadoop.mapreduce.Job

1. Download the Taxi Trips

%sh
# latest available MSR Beijing Taxi trajectory downloaded...
# if you are in the databricks community edition you should NOT execute this cell and download the premade all.txt.gz file as explained in the next line
# wget http://lamastex.org/datasets/public/geospatial/msr/all.txt.gz
wget http://lamastex.org/datasets/public/geospatial/msr/T-driveTaxiTrajectories.zip
--2019-06-19 09:16:04-- http://lamastex.org/datasets/public/geospatial/msr/T-driveTaxiTrajectories.zip Resolving lamastex.org (lamastex.org)... 166.62.28.100 Connecting to lamastex.org (lamastex.org)|166.62.28.100|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 153217794 (146M) [application/zip] Saving to: ‘T-driveTaxiTrajectories.zip’ 0K .......... .......... .......... .......... .......... 0% 149K 16m45s 50K .......... .......... .......... .......... .......... 0% 296K 12m35s 100K .......... .......... .......... .......... .......... 0% 298K 11m10s 150K .......... .......... .......... .......... .......... 0% 41.9M 8m23s 200K .......... .......... .......... .......... .......... 0% 300K 8m22s 250K .......... .......... .......... .......... .......... 0% 46.2M 6m59s 300K .......... .......... .......... .......... .......... 0% 50.3M 5m59s 350K .......... .......... .......... .......... .......... 0% 41.6M 5m15s 400K .......... .......... .......... .......... .......... 0% 43.4M 4m40s 450K .......... .......... .......... .......... .......... 0% 304K 5m1s 500K .......... .......... .......... .......... .......... 0% 44.7M 4m34s 550K .......... .......... .......... .......... .......... 0% 46.2M 4m11s 600K .......... .......... .......... .......... .......... 0% 43.0M 3m52s 650K .......... .......... .......... .......... .......... 0% 49.0M 3m36s 700K .......... .......... .......... .......... .......... 0% 43.8M 3m21s 750K .......... .......... .......... .......... .......... 0% 41.5M 3m9s 800K .......... .......... .......... .......... .......... 0% 310K 3m26s 850K .......... .......... .......... .......... .......... 0% 53.8M 3m15s 900K .......... .......... .......... .......... .......... 0% 33.4M 3m5s 950K .......... .......... .......... .......... .......... 0% 50.8M 2m55s 1000K .......... .......... .......... .......... .......... 0% 37.8M 2m47s 1050K .......... .......... .......... .......... .......... 0% 43.1M 2m40s 1100K .......... .......... .......... .......... .......... 0% 40.2M 2m33s 1150K .......... .......... .......... .......... .......... 0% 45.2M 2m27s 1200K .......... .......... .......... .......... .......... 0% 43.5M 2m21s 1250K .......... .......... .......... .......... .......... 0% 37.0M 2m15s 1300K .......... .......... .......... .......... .......... 0% 55.2M 2m11s 1350K .......... .......... .......... .......... .......... 0% 39.4M 2m6s 1400K .......... .......... .......... .......... .......... 0% 323K 2m17s 1450K .......... .......... .......... .......... .......... 1% 45.2M 2m13s 1500K .......... .......... .......... .......... .......... 1% 39.5M 2m9s 1550K .......... .......... .......... .......... .......... 1% 50.9M 2m5s 1600K .......... .......... .......... .......... .......... 1% 36.8M 2m1s 1650K .......... .......... .......... .......... .......... 1% 47.2M 1m57s 1700K .......... .......... .......... .......... .......... 1% 66.2M 1m54s 1750K .......... .......... .......... .......... .......... 1% 44.1M 1m51s 1800K .......... .......... .......... .......... .......... 1% 38.0M 1m48s 1850K .......... .......... .......... .......... .......... 1% 46.7M 1m45s 1900K .......... .......... .......... .......... .......... 1% 29.7M 1m43s 1950K .......... .......... .......... .......... .......... 1% 45.6M 1m40s 2000K .......... .......... .......... .......... .......... 1% 33.1M 98s 2050K .......... .......... .......... .......... .......... 1% 55.0M 95s 2100K .......... .......... .......... .......... .......... 1% 43.7M 93s 2150K .......... .......... .......... .......... .......... 1% 46.4M 91s 2200K .......... .......... .......... .......... .......... 1% 43.8M 89s 2250K .......... .......... .......... .......... .......... 1% 45.4M 87s 2300K .......... .......... .......... .......... .......... 1% 40.1M 86s 2350K .......... .......... .......... .......... .......... 1% 55.0M 84s 2400K .......... .......... .......... .......... .......... 1% 40.8M 82s 2450K .......... .......... .......... .......... .......... 1% 342K 89s 2500K .......... .......... .......... .......... .......... 1% 40.1M 87s 2550K .......... .......... .......... .......... .......... 1% 52.1M 86s 2600K .......... .......... .......... .......... .......... 1% 46.4M 84s 2650K .......... .......... .......... .......... .......... 1% 46.2M 83s 2700K .......... .......... .......... .......... .......... 1% 47.5M 81s 2750K .......... .......... .......... .......... .......... 1% 44.2M 80s 2800K .......... .......... .......... .......... .......... 1% 46.8M 78s 2850K .......... .......... .......... .......... .......... 1% 40.8M 77s 2900K .......... .......... .......... .......... .......... 1% 35.0M 76s 2950K .......... .......... .......... .......... .......... 2% 48.1M 74s 3000K .......... .......... .......... .......... .......... 2% 49.2M 73s 3050K .......... .......... .......... .......... .......... 2% 44.3M 72s 3100K .......... .......... .......... .......... .......... 2% 38.3M 71s 3150K .......... .......... .......... .......... .......... 2% 48.8M 70s 3200K .......... .......... .......... .......... .......... 2% 49.2M 69s 3250K .......... .......... .......... .......... .......... 2% 45.9M 68s 3300K .......... .......... .......... .......... .......... 2% 38.5M 67s 3350K .......... .......... .......... .......... .......... 2% 41.6M 66s 3400K .......... .......... .......... .......... .......... 2% 39.2M 65s 3450K .......... .......... .......... .......... .......... 2% 48.1M 64s 3500K .......... .......... .......... .......... .......... 2% 41.8M 63s 3550K .......... .......... .......... .......... .......... 2% 41.4M 62s 3600K .......... .......... .......... .......... .......... 2% 48.2M 62s 3650K .......... .......... .......... .......... .......... 2% 41.4M 61s 3700K .......... .......... .......... .......... .......... 2% 51.8M 60s 3750K .......... .......... .......... .......... .......... 2% 48.1M 59s 3800K .......... .......... .......... .......... .......... 2% 43.5M 58s 3850K .......... .......... .......... .......... .......... 2% 40.5M 58s 3900K .......... .......... .......... .......... .......... 2% 49.1M 57s 3950K .......... .......... .......... .......... .......... 2% 368K 61s 4000K .......... .......... .......... .......... .......... 2% 45.9M 60s 4050K .......... .......... .......... .......... .......... 2% 48.7M 60s 4100K .......... .......... .......... .......... .......... 2% 40.7M 59s 4150K .......... .......... .......... .......... .......... 2% 44.8M 58s 4200K .......... .......... .......... .......... .......... 2% 50.9M 58s 4250K .......... .......... .......... .......... .......... 2% 47.0M 57s 4300K .......... .......... .......... .......... .......... 2% 42.3M 56s 4350K .......... .......... .......... .......... .......... 2% 43.6M 56s 4400K .......... .......... .......... .......... .......... 2% 43.3M 55s 4450K .......... .......... .......... .......... .......... 3% 43.0M 55s 4500K .......... .......... .......... .......... .......... 3% 42.6M 54s 4550K .......... .......... .......... .......... .......... 3% 46.6M 53s 4600K .......... .......... .......... .......... .......... 3% 46.2M 53s 4650K .......... .......... .......... .......... .......... 3% 39.9M 52s 4700K .......... .......... .......... .......... .......... 3% 47.8M 52s 4750K .......... .......... .......... .......... .......... 3% 37.4M 51s 4800K .......... .......... .......... .......... .......... 3% 43.8M 51s 4850K .......... .......... .......... .......... .......... 3% 56.5M 50s 4900K .......... .......... .......... .......... .......... 3% 24.9M 50s 4950K .......... .......... .......... .......... .......... 3% 44.8M 49s 5000K .......... .......... .......... .......... .......... 3% 52.0M 49s 5050K .......... .......... .......... .......... .......... 3% 44.2M 48s 5100K .......... .......... .......... .......... .......... 3% 39.8M 48s 5150K .......... .......... .......... .......... .......... 3% 42.4M 47s 5200K .......... .......... .......... .......... .......... 3% 37.8M 47s 5250K .......... .......... .......... .......... .......... 3% 45.9M 47s 5300K .......... .......... .......... .......... .......... 3% 43.7M 46s 5350K .......... .......... .......... .......... .......... 3% 44.5M 46s 5400K .......... .......... .......... .......... .......... 3% 34.0M 45s 5450K .......... .......... .......... .......... .......... 3% 71.7M 45s 5500K .......... .......... .......... .......... .......... 3% 372K 48s 5550K .......... .......... .......... .......... .......... 3% 39.4M 48s 5600K .......... .......... .......... .......... .......... 3% 42.5M 47s 5650K .......... .......... .......... .......... .......... 3% 42.7M 47s 5700K .......... .......... .......... .......... .......... 3% 45.4M 46s 5750K .......... .......... .......... .......... .......... 3% 40.4M 46s 5800K .......... .......... .......... .......... .......... 3% 37.4M 46s 5850K .......... .......... .......... .......... .......... 3% 53.5M 45s 5900K .......... .......... .......... .......... .......... 3% 43.6M 45s 5950K .......... .......... .......... .......... .......... 4% 42.6M 45s 6000K .......... .......... .......... .......... .......... 4% 61.4M 44s 6050K .......... .......... .......... .......... .......... 4% 36.4M 44s 6100K .......... .......... .......... .......... .......... 4% 37.0M 43s 6150K .......... .......... .......... .......... .......... 4% 55.3M 43s 6200K .......... .......... .......... .......... .......... 4% 36.0M 43s 6250K .......... .......... .......... .......... .......... 4% 34.1M 42s 6300K .......... .......... .......... .......... .......... 4% 76.1M 42s 6350K .......... .......... .......... .......... .......... 4% 31.2M 42s 6400K .......... .......... .......... .......... .......... 4% 39.3M 42s 6450K .......... .......... .......... .......... .......... 4% 45.9M 41s 6500K .......... .......... .......... .......... .......... 4% 38.9M 41s 6550K .......... .......... .......... .......... .......... 4% 47.3M 41s 6600K .......... .......... .......... .......... .......... 4% 46.2M 40s 6650K .......... .......... .......... .......... .......... 4% 48.1M 40s 6700K .......... .......... .......... .......... .......... 4% 38.9M 40s 6750K .......... .......... .......... .......... .......... 4% 17.1M 39s 6800K .......... .......... .......... .......... .......... 4% 39.3M 39s 6850K .......... .......... .......... .......... .......... 4% 43.9M 39s 6900K .......... .......... .......... .......... .......... 4% 39.6M 39s 6950K .......... .......... .......... .......... .......... 4% 43.7M 38s 7000K .......... .......... .......... .......... .......... 4% 376K 41s 7050K .......... .......... .......... .......... .......... 4% 41.9M 41s 7100K .......... .......... .......... .......... .......... 4% 38.6M 40s 7150K .......... .......... .......... .......... .......... 4% 54.4M 40s 7200K .......... .......... .......... .......... .......... 4% 42.9M 40s 7250K .......... .......... .......... .......... .......... 4% 44.1M 39s 7300K .......... .......... .......... .......... .......... 4% 43.9M 39s 7350K .......... .......... .......... .......... .......... 4% 46.0M 39s 7400K .......... .......... .......... .......... .......... 4% 49.5M 39s 7450K .......... .......... .......... .......... .......... 5% 39.1M 38s 7500K .......... .......... .......... .......... .......... 5% 44.9M 38s 7550K .......... .......... .......... .......... .......... 5% 48.6M 38s 7600K .......... .......... .......... .......... .......... 5% 42.3M 38s 7650K .......... .......... .......... .......... .......... 5% 36.8M 37s 7700K .......... .......... .......... .......... .......... 5% 26.8M 37s 7750K .......... .......... .......... .......... .......... 5% 41.5M 37s 7800K .......... .......... .......... .......... .......... 5% 27.3M 37s 7850K .......... .......... .......... .......... .......... 5% 32.8M 37s 7900K .......... .......... .......... .......... .......... 5% 43.5M 36s 7950K .......... .......... .......... .......... .......... 5% 40.4M 36s 8000K .......... .......... .......... .......... .......... 5% 43.5M 36s 8050K .......... .......... .......... .......... .......... 5% 35.4M 36s 8100K .......... .......... .......... .......... .......... 5% 45.1M 35s 8150K .......... .......... .......... .......... .......... 5% 35.5M 35s 8200K .......... .......... .......... .......... .......... 5% 34.0M 35s 8250K .......... .......... .......... .......... .......... 5% 34.6M 35s 8300K .......... .......... .......... .......... .......... 5% 22.6M 35s 8350K .......... .......... .......... .......... .......... 5% 35.0M 34s 8400K .......... .......... .......... .......... .......... 5% 37.6M 34s 8450K .......... .......... .......... .......... .......... 5% 43.3M 34s 8500K .......... .......... .......... .......... .......... 5% 51.9M 34s 8550K .......... .......... .......... .......... .......... 5% 382K 36s 8600K .......... .......... .......... .......... .......... 5% 41.5M 36s 8650K .......... .......... .......... .......... .......... 5% 48.8M 35s 8700K .......... .......... .......... .......... .......... 5% 28.1M 35s 8750K .......... .......... .......... .......... .......... 5% 34.1M 35s 8800K .......... .......... .......... .......... .......... 5% 41.7M 35s 8850K .......... .......... .......... .......... .......... 5% 41.9M 35s 8900K .......... .......... .......... .......... .......... 5% 36.6M 34s 8950K .......... .......... .......... .......... .......... 6% 28.6M 34s 9000K .......... .......... .......... .......... .......... 6% 34.8M 34s 9050K .......... .......... .......... .......... .......... 6% 43.9M 34s 9100K .......... .......... .......... .......... .......... 6% 43.7M 34s 9150K .......... .......... .......... .......... .......... 6% 41.2M 34s 9200K .......... .......... .......... .......... .......... 6% 41.3M 33s 9250K .......... .......... .......... .......... .......... 6% 35.7M 33s 9300K .......... .......... .......... .......... .......... 6% 47.0M 33s 9350K .......... .......... .......... .......... .......... 6% 36.3M 33s 9400K .......... .......... .......... .......... .......... 6% 44.3M 33s 9450K .......... .......... .......... .......... .......... 6% 39.6M 33s 9500K .......... .......... .......... .......... .......... 6% 44.4M 32s 9550K .......... .......... .......... .......... .......... 6% 41.1M 32s 9600K .......... .......... .......... .......... .......... 6% 52.1M 32s 9650K .......... .......... .......... .......... .......... 6% 34.8M 32s 9700K .......... .......... .......... .......... .......... 6% 36.7M 32s 9750K .......... .......... .......... .......... .......... 6% 48.0M 32s 9800K .......... .......... .......... .......... .......... 6% 31.1M 31s 9850K .......... .......... .......... .......... .......... 6% 28.3M 31s 9900K .......... .......... .......... .......... .......... 6% 38.0M 31s 9950K .......... .......... .......... .......... .......... 6% 34.2M 31s 10000K .......... .......... .......... .......... .......... 6% 40.1M 31s 10050K .......... .......... .......... .......... .......... 6% 47.8M 31s 10100K .......... .......... .......... .......... .......... 6% 370K 32s 10150K .......... .......... .......... .......... .......... 6% 33.9M 32s 10200K .......... .......... .......... .......... .......... 6% 41.6M 32s 10250K .......... .......... .......... .......... .......... 6% 40.5M 32s 10300K .......... .......... .......... .......... .......... 6% 48.4M 32s 10350K .......... .......... .......... .......... .......... 6% 53.4M 32s 10400K .......... .......... .......... .......... .......... 6% 45.3M 32s 10450K .......... .......... .......... .......... .......... 7% 46.2M 31s 10500K .......... .......... .......... .......... .......... 7% 34.6M 31s 10550K .......... .......... .......... .......... .......... 7% 38.0M 31s 10600K .......... .......... .......... .......... .......... 7% 47.1M 31s 10650K .......... .......... .......... .......... .......... 7% 48.7M 31s 10700K .......... .......... .......... .......... .......... 7% 48.5M 31s 10750K .......... .......... .......... .......... .......... 7% 40.9M 31s 10800K .......... .......... .......... .......... .......... 7% 51.9M 30s 10850K .......... .......... .......... .......... .......... 7% 40.3M 30s 10900K .......... .......... .......... .......... .......... 7% 52.6M 30s 10950K .......... .......... .......... .......... .......... 7% 32.9M 30s 11000K .......... .......... .......... .......... .......... 7% 46.4M 30s 11050K .......... .......... .......... .......... .......... 7% 41.9M 30s 11100K .......... .......... .......... .......... .......... 7% 40.5M 30s 11150K .......... .......... .......... .......... .......... 7% 43.1M 29s 11200K .......... .......... .......... .......... .......... 7% 33.6M 29s 11250K .......... .......... .......... .......... .......... 7% 43.0M 29s 11300K .......... .......... .......... .......... .......... 7% 47.3M 29s 11350K .......... .......... .......... .......... .......... 7% 36.3M 29s 11400K .......... .......... .......... .......... .......... 7% 48.6M 29s 11450K .......... .......... .......... .......... .......... 7% 36.6M 29s 11500K .......... .......... .......... .......... .......... 7% 27.6M 29s 11550K .......... .......... .......... .......... .......... 7% 37.2M 28s 11600K .......... .......... .......... .......... .......... 7% 1.20M 29s 11650K .......... .......... .......... .......... .......... 7% 527K 30s 11700K .......... .......... .......... .......... .......... 7% 42.4M 30s 11750K .......... .......... .......... .......... .......... 7% 43.2M 30s 11800K .......... .......... .......... .......... .......... 7% 42.9M 29s 11850K .......... .......... .......... .......... .......... 7% 39.1M 29s 11900K .......... .......... .......... .......... .......... 7% 53.1M 29s 11950K .......... .......... .......... .......... .......... 8% 45.7M 29s 12000K .......... .......... .......... .......... .......... 8% 42.2M 29s 12050K .......... .......... .......... .......... .......... 8% 43.3M 29s 12100K .......... .......... .......... .......... .......... 8% 31.1M 29s 12150K .......... .......... .......... .......... .......... 8% 44.6M 29s 12200K .......... .......... .......... .......... .......... 8% 37.4M 29s 12250K .......... .......... .......... .......... .......... 8% 47.0M 28s 12300K .......... .......... .......... .......... .......... 8% 55.5M 28s 12350K .......... .......... .......... .......... .......... 8% 42.3M 28s 12400K .......... .......... .......... .......... .......... 8% 42.8M 28s 12450K .......... .......... .......... .......... .......... 8% 40.7M 28s 12500K .......... .......... .......... .......... .......... 8% 29.0M 28s 12550K .......... .......... .......... .......... .......... 8% 74.2M 28s 12600K .......... .......... .......... .......... .......... 8% 22.3M 28s 12650K .......... .......... .......... .......... .......... 8% 70.8M 28s 12700K .......... .......... .......... .......... .......... 8% 58.5M 27s 12750K .......... .......... .......... .......... .......... 8% 40.2M 27s 12800K .......... .......... .......... .......... .......... 8% 43.9M 27s 12850K .......... .......... .......... .......... .......... 8% 50.2M 27s 12900K .......... .......... .......... .......... .......... 8% 39.1M 27s 12950K .......... .......... .......... .......... .......... 8% 47.5M 27s 13000K .......... .......... .......... .......... .......... 8% 31.3M 27s 13050K .......... .......... .......... .......... .......... 8% 42.9M 27s 13100K .......... .......... .......... .......... .......... 8% 42.6M 27s 13150K .......... .......... .......... .......... .......... 8% 375K 28s 13200K .......... .......... .......... .......... .......... 8% 26.3M 28s 13250K .......... .......... .......... .......... .......... 8% 40.4M 28s 13300K .......... .......... .......... .......... .......... 8% 39.3M 28s 13350K .......... .......... .......... .......... .......... 8% 48.8M 27s 13400K .......... .......... .......... .......... .......... 8% 51.7M 27s 13450K .......... .......... .......... .......... .......... 9% 36.9M 27s 13500K .......... .......... .......... .......... .......... 9% 51.8M 27s 13550K .......... .......... .......... .......... .......... 9% 41.1M 27s 13600K .......... .......... .......... .......... .......... 9% 48.1M 27s 13650K .......... .......... .......... .......... .......... 9% 40.2M 27s 13700K .......... .......... .......... .......... .......... 9% 17.8M 27s 13750K .......... .......... .......... .......... .......... 9% 44.6M 27s 13800K .......... .......... .......... .......... .......... 9% 39.9M 27s 13850K .......... .......... .......... .......... .......... 9% 45.6M 27s 13900K .......... .......... .......... .......... .......... 9% 34.5M 26s 13950K .......... .......... .......... .......... .......... 9% 31.8M 26s 14000K .......... .......... .......... .......... .......... 9% 34.7M 26s 14050K .......... .......... .......... .......... .......... 9% 25.8M 26s 14100K .......... .......... .......... .......... .......... 9% 21.5M 26s 14150K .......... .......... .......... .......... .......... 9% 76.3M 26s 14200K .......... .......... .......... .......... .......... 9% 204M 26s 14250K .......... .......... .......... .......... .......... 9% 39.4M 26s 14300K .......... .......... .......... .......... .......... 9% 38.3M 26s 14350K .......... .......... .......... .......... .......... 9% 47.1M 26s 14400K .......... .......... .......... .......... .......... 9% 43.0M 26s 14450K .......... .......... .......... .......... .......... 9% 38.9M 25s 14500K .......... .......... .......... .......... .......... 9% 43.5M 25s 14550K .......... .......... .......... .......... .......... 9% 42.7M 25s 14600K .......... .......... .......... .......... .......... 9% 38.6M 25s 14650K .......... .......... .......... .......... .......... 9% 45.7M 25s 14700K .......... .......... .......... .......... .......... 9% 380K 26s 14750K .......... .......... .......... .......... .......... 9% 37.5M 26s 14800K .......... .......... .......... .......... .......... 9% 43.5M 26s 14850K .......... .......... .......... .......... .......... 9% 32.3M 26s 14900K .......... .......... .......... .......... .......... 9% 49.2M 26s 14950K .......... .......... .......... .......... .......... 10% 52.9M 26s 15000K .......... .......... .......... .......... .......... 10% 37.7M 26s 15050K .......... .......... .......... .......... .......... 10% 44.3M 26s 15100K .......... .......... .......... .......... .......... 10% 63.6M 26s 15150K .......... .......... .......... .......... .......... 10% 54.8M 25s 15200K .......... .......... .......... .......... .......... 10% 17.9M 25s 15250K .......... .......... .......... .......... .......... 10% 19.3M 25s 15300K .......... .......... .......... .......... .......... 10% 40.5M 25s 15350K .......... .......... .......... .......... .......... 10% 48.9M 25s 15400K .......... .......... .......... .......... .......... 10% 34.0M 25s 15450K .......... .......... .......... .......... .......... 10% 56.3M 25s 15500K .......... .......... .......... .......... .......... 10% 42.5M 25s 15550K .......... .......... .......... .......... .......... 10% 49.0M 25s 15600K .......... .......... .......... .......... .......... 10% 50.9M 25s 15650K .......... .......... .......... .......... .......... 10% 44.9M 25s 15700K .......... .......... .......... .......... .......... 10% 46.4M 25s 15750K .......... .......... .......... .......... .......... 10% 41.2M 24s 15800K .......... .......... .......... .......... .......... 10% 26.2M 24s 15850K .......... .......... .......... .......... .......... 10% 37.4M 24s 15900K .......... .......... .......... .......... .......... 10% 50.3M 24s *** WARNING: skipped 179535 bytes of output *** 133300K .......... .......... .......... .......... .......... 89% 19.2M 2s 133350K .......... .......... .......... .......... .......... 89% 22.7M 2s 133400K .......... .......... .......... .......... .......... 89% 20.0M 2s 133450K .......... .......... .......... .......... .......... 89% 259M 2s 133500K .......... .......... .......... .......... .......... 89% 48.2M 2s 133550K .......... .......... .......... .......... .......... 89% 42.1M 2s 133600K .......... .......... .......... .......... .......... 89% 34.4M 2s 133650K .......... .......... .......... .......... .......... 89% 51.4M 2s 133700K .......... .......... .......... .......... .......... 89% 18.4M 2s 133750K .......... .......... .......... .......... .......... 89% 35.6M 2s 133800K .......... .......... .......... .......... .......... 89% 15.2M 2s 133850K .......... .......... .......... .......... .......... 89% 8.88M 2s 133900K .......... .......... .......... .......... .......... 89% 24.0M 2s 133950K .......... .......... .......... .......... .......... 89% 11.9M 2s 134000K .......... .......... .......... .......... .......... 89% 7.92M 2s 134050K .......... .......... .......... .......... .......... 89% 25.1M 2s 134100K .......... .......... .......... .......... .......... 89% 16.6M 2s 134150K .......... .......... .......... .......... .......... 89% 21.4M 2s 134200K .......... .......... .......... .......... .......... 89% 911K 2s 134250K .......... .......... .......... .......... .......... 89% 1.15M 2s 134300K .......... .......... .......... .......... .......... 89% 47.7M 2s 134350K .......... .......... .......... .......... .......... 89% 30.5M 2s 134400K .......... .......... .......... .......... .......... 89% 8.01M 2s 134450K .......... .......... .......... .......... .......... 89% 17.8M 2s 134500K .......... .......... .......... .......... .......... 89% 23.2M 2s 134550K .......... .......... .......... .......... .......... 89% 16.8M 2s 134600K .......... .......... .......... .......... .......... 89% 20.1M 2s 134650K .......... .......... .......... .......... .......... 90% 30.1M 2s 134700K .......... .......... .......... .......... .......... 90% 27.8M 2s 134750K .......... .......... .......... .......... .......... 90% 29.1M 2s 134800K .......... .......... .......... .......... .......... 90% 15.5M 2s 134850K .......... .......... .......... .......... .......... 90% 19.0M 2s 134900K .......... .......... .......... .......... .......... 90% 19.1M 2s 134950K .......... .......... .......... .......... .......... 90% 20.0M 2s 135000K .......... .......... .......... .......... .......... 90% 42.3M 2s 135050K .......... .......... .......... .......... .......... 90% 46.6M 2s 135100K .......... .......... .......... .......... .......... 90% 35.2M 2s 135150K .......... .......... .......... .......... .......... 90% 38.4M 2s 135200K .......... .......... .......... .......... .......... 90% 46.4M 2s 135250K .......... .......... .......... .......... .......... 90% 41.3M 2s 135300K .......... .......... .......... .......... .......... 90% 26.9M 2s 135350K .......... .......... .......... .......... .......... 90% 17.4M 2s 135400K .......... .......... .......... .......... .......... 90% 9.05M 2s 135450K .......... .......... .......... .......... .......... 90% 15.2M 2s 135500K .......... .......... .......... .......... .......... 90% 17.1M 2s 135550K .......... .......... .......... .......... .......... 90% 6.90M 2s 135600K .......... .......... .......... .......... .......... 90% 17.0M 2s 135650K .......... .......... .......... .......... .......... 90% 23.3M 2s 135700K .......... .......... .......... .......... .......... 90% 1.25M 2s 135750K .......... .......... .......... .......... .......... 90% 2.61M 2s 135800K .......... .......... .......... .......... .......... 90% 1.20M 2s 135850K .......... .......... .......... .......... .......... 90% 38.4M 2s 135900K .......... .......... .......... .......... .......... 90% 29.2M 2s 135950K .......... .......... .......... .......... .......... 90% 6.84M 2s 136000K .......... .......... .......... .......... .......... 90% 20.5M 2s 136050K .......... .......... .......... .......... .......... 90% 36.9M 2s 136100K .......... .......... .......... .......... .......... 90% 12.8M 2s 136150K .......... .......... .......... .......... .......... 91% 29.8M 2s 136200K .......... .......... .......... .......... .......... 91% 35.6M 2s 136250K .......... .......... .......... .......... .......... 91% 27.8M 2s 136300K .......... .......... .......... .......... .......... 91% 20.9M 2s 136350K .......... .......... .......... .......... .......... 91% 15.7M 2s 136400K .......... .......... .......... .......... .......... 91% 21.6M 2s 136450K .......... .......... .......... .......... .......... 91% 12.2M 2s 136500K .......... .......... .......... .......... .......... 91% 50.7M 2s 136550K .......... .......... .......... .......... .......... 91% 41.9M 2s 136600K .......... .......... .......... .......... .......... 91% 35.3M 2s 136650K .......... .......... .......... .......... .......... 91% 39.1M 2s 136700K .......... .......... .......... .......... .......... 91% 44.9M 2s 136750K .......... .......... .......... .......... .......... 91% 19.3M 2s 136800K .......... .......... .......... .......... .......... 91% 44.3M 2s 136850K .......... .......... .......... .......... .......... 91% 44.6M 2s 136900K .......... .......... .......... .......... .......... 91% 27.0M 2s 136950K .......... .......... .......... .......... .......... 91% 8.67M 1s 137000K .......... .......... .......... .......... .......... 91% 10.7M 1s 137050K .......... .......... .......... .......... .......... 91% 7.96M 1s 137100K .......... .......... .......... .......... .......... 91% 23.2M 1s 137150K .......... .......... .......... .......... .......... 91% 17.1M 1s 137200K .......... .......... .......... .......... .......... 91% 19.1M 1s 137250K .......... .......... .......... .......... .......... 91% 887K 1s 137300K .......... .......... .......... .......... .......... 91% 1.33M 1s 137350K .......... .......... .......... .......... .......... 91% 8.66M 1s 137400K .......... .......... .......... .......... .......... 91% 51.7M 1s 137450K .......... .......... .......... .......... .......... 91% 31.4M 1s 137500K .......... .......... .......... .......... .......... 91% 6.64M 1s 137550K .......... .......... .......... .......... .......... 91% 23.9M 1s 137600K .......... .......... .......... .......... .......... 91% 30.2M 1s 137650K .......... .......... .......... .......... .......... 92% 13.5M 1s 137700K .......... .......... .......... .......... .......... 92% 29.8M 1s 137750K .......... .......... .......... .......... .......... 92% 22.8M 1s 137800K .......... .......... .......... .......... .......... 92% 39.8M 1s 137850K .......... .......... .......... .......... .......... 92% 14.2M 1s 137900K .......... .......... .......... .......... .......... 92% 19.2M 1s 137950K .......... .......... .......... .......... .......... 92% 21.9M 1s 138000K .......... .......... .......... .......... .......... 92% 15.3M 1s 138050K .......... .......... .......... .......... .......... 92% 53.8M 1s 138100K .......... .......... .......... .......... .......... 92% 32.0M 1s 138150K .......... .......... .......... .......... .......... 92% 31.4M 1s 138200K .......... .......... .......... .......... .......... 92% 30.2M 1s 138250K .......... .......... .......... .......... .......... 92% 45.4M 1s 138300K .......... .......... .......... .......... .......... 92% 29.3M 1s 138350K .......... .......... .......... .......... .......... 92% 37.0M 1s 138400K .......... .......... .......... .......... .......... 92% 37.5M 1s 138450K .......... .......... .......... .......... .......... 92% 8.59M 1s 138500K .......... .......... .......... .......... .......... 92% 24.7M 1s 138550K .......... .......... .......... .......... .......... 92% 11.6M 1s 138600K .......... .......... .......... .......... .......... 92% 7.10M 1s 138650K .......... .......... .......... .......... .......... 92% 41.1M 1s 138700K .......... .......... .......... .......... .......... 92% 17.4M 1s 138750K .......... .......... .......... .......... .......... 92% 19.8M 1s 138800K .......... .......... .......... .......... .......... 92% 882K 1s 138850K .......... .......... .......... .......... .......... 92% 1.21M 1s 138900K .......... .......... .......... .......... .......... 92% 26.9M 1s 138950K .......... .......... .......... .......... .......... 92% 38.6M 1s 139000K .......... .......... .......... .......... .......... 92% 8.72M 1s 139050K .......... .......... .......... .......... .......... 92% 16.9M 1s 139100K .......... .......... .......... .......... .......... 92% 25.6M 1s 139150K .......... .......... .......... .......... .......... 93% 12.4M 1s 139200K .......... .......... .......... .......... .......... 93% 30.3M 1s 139250K .......... .......... .......... .......... .......... 93% 24.6M 1s 139300K .......... .......... .......... .......... .......... 93% 25.4M 1s 139350K .......... .......... .......... .......... .......... 93% 40.5M 1s 139400K .......... .......... .......... .......... .......... 93% 13.5M 1s 139450K .......... .......... .......... .......... .......... 93% 22.3M 1s 139500K .......... .......... .......... .......... .......... 93% 11.6M 1s 139550K .......... .......... .......... .......... .......... 93% 22.6M 1s 139600K .......... .......... .......... .......... .......... 93% 33.0M 1s 139650K .......... .......... .......... .......... .......... 93% 46.1M 1s 139700K .......... .......... .......... .......... .......... 93% 37.2M 1s 139750K .......... .......... .......... .......... .......... 93% 49.1M 1s 139800K .......... .......... .......... .......... .......... 93% 45.9M 1s 139850K .......... .......... .......... .......... .......... 93% 30.2M 1s 139900K .......... .......... .......... .......... .......... 93% 43.0M 1s 139950K .......... .......... .......... .......... .......... 93% 31.6M 1s 140000K .......... .......... .......... .......... .......... 93% 8.79M 1s 140050K .......... .......... .......... .......... .......... 93% 10.5M 1s 140100K .......... .......... .......... .......... .......... 93% 34.0M 1s 140150K .......... .......... .......... .......... .......... 93% 7.31M 1s 140200K .......... .......... .......... .......... .......... 93% 17.1M 1s 140250K .......... .......... .......... .......... .......... 93% 23.1M 1s 140300K .......... .......... .......... .......... .......... 93% 877K 1s 140350K .......... .......... .......... .......... .......... 93% 1.32M 1s 140400K .......... .......... .......... .......... .......... 93% 8.81M 1s 140450K .......... .......... .......... .......... .......... 93% 45.9M 1s 140500K .......... .......... .......... .......... .......... 93% 36.0M 1s 140550K .......... .......... .......... .......... .......... 93% 6.89M 1s 140600K .......... .......... .......... .......... .......... 94% 21.2M 1s 140650K .......... .......... .......... .......... .......... 94% 46.8M 1s 140700K .......... .......... .......... .......... .......... 94% 13.0M 1s 140750K .......... .......... .......... .......... .......... 94% 22.3M 1s 140800K .......... .......... .......... .......... .......... 94% 33.6M 1s 140850K .......... .......... .......... .......... .......... 94% 23.2M 1s 140900K .......... .......... .......... .......... .......... 94% 15.1M 1s 140950K .......... .......... .......... .......... .......... 94% 21.2M 1s 141000K .......... .......... .......... .......... .......... 94% 22.1M 1s 141050K .......... .......... .......... .......... .......... 94% 14.1M 1s 141100K .......... .......... .......... .......... .......... 94% 25.1M 1s 141150K .......... .......... .......... .......... .......... 94% 27.6M 1s 141200K .......... .......... .......... .......... .......... 94% 45.7M 1s 141250K .......... .......... .......... .......... .......... 94% 43.3M 1s 141300K .......... .......... .......... .......... .......... 94% 47.0M 1s 141350K .......... .......... .......... .......... .......... 94% 46.6M 1s 141400K .......... .......... .......... .......... .......... 94% 31.5M 1s 141450K .......... .......... .......... .......... .......... 94% 47.4M 1s 141500K .......... .......... .......... .......... .......... 94% 26.5M 1s 141550K .......... .......... .......... .......... .......... 94% 7.89M 1s 141600K .......... .......... .......... .......... .......... 94% 11.8M 1s 141650K .......... .......... .......... .......... .......... 94% 7.64M 1s 141700K .......... .......... .......... .......... .......... 94% 34.8M 1s 141750K .......... .......... .......... .......... .......... 94% 16.4M 1s 141800K .......... .......... .......... .......... .......... 94% 25.1M 1s 141850K .......... .......... .......... .......... .......... 94% 876K 1s 141900K .......... .......... .......... .......... .......... 94% 1.25M 1s 141950K .......... .......... .......... .......... .......... 94% 14.4M 1s 142000K .......... .......... .......... .......... .......... 94% 40.3M 1s 142050K .......... .......... .......... .......... .......... 94% 34.7M 1s 142100K .......... .......... .......... .......... .......... 95% 7.20M 1s 142150K .......... .......... .......... .......... .......... 95% 22.6M 1s 142200K .......... .......... .......... .......... .......... 95% 13.2M 1s 142250K .......... .......... .......... .......... .......... 95% 18.8M 1s 142300K .......... .......... .......... .......... .......... 95% 51.0M 1s 142350K .......... .......... .......... .......... .......... 95% 30.2M 1s 142400K .......... .......... .......... .......... .......... 95% 27.8M 1s 142450K .......... .......... .......... .......... .......... 95% 15.3M 1s 142500K .......... .......... .......... .......... .......... 95% 18.6M 1s 142550K .......... .......... .......... .......... .......... 95% 11.4M 1s 142600K .......... .......... .......... .......... .......... 95% 24.0M 1s 142650K .......... .......... .......... .......... .......... 95% 34.9M 1s 142700K .......... .......... .......... .......... .......... 95% 36.6M 1s 142750K .......... .......... .......... .......... .......... 95% 29.2M 1s 142800K .......... .......... .......... .......... .......... 95% 32.0M 1s 142850K .......... .......... .......... .......... .......... 95% 54.8M 1s 142900K .......... .......... .......... .......... .......... 95% 45.9M 1s 142950K .......... .......... .......... .......... .......... 95% 57.9M 1s 143000K .......... .......... .......... .......... .......... 95% 30.0M 1s 143050K .......... .......... .......... .......... .......... 95% 8.95M 1s 143100K .......... .......... .......... .......... .......... 95% 11.5M 1s 143150K .......... .......... .......... .......... .......... 95% 28.9M 1s 143200K .......... .......... .......... .......... .......... 95% 7.28M 1s 143250K .......... .......... .......... .......... .......... 95% 17.1M 1s 143300K .......... .......... .......... .......... .......... 95% 29.1M 1s 143350K .......... .......... .......... .......... .......... 95% 24.8M 1s 143400K .......... .......... .......... .......... .......... 95% 882K 1s 143450K .......... .......... .......... .......... .......... 95% 1.21M 1s 143500K .......... .......... .......... .......... .......... 95% 16.2M 1s 143550K .......... .......... .......... .......... .......... 95% 44.6M 1s 143600K .......... .......... .......... .......... .......... 96% 10.4M 1s 143650K .......... .......... .......... .......... .......... 96% 13.1M 1s 143700K .......... .......... .......... .......... .......... 96% 46.3M 1s 143750K .......... .......... .......... .......... .......... 96% 12.5M 1s 143800K .......... .......... .......... .......... .......... 96% 19.8M 1s 143850K .......... .......... .......... .......... .......... 96% 46.0M 1s 143900K .......... .......... .......... .......... .......... 96% 26.7M 1s 143950K .......... .......... .......... .......... .......... 96% 27.8M 1s 144000K .......... .......... .......... .......... .......... 96% 11.4M 1s 144050K .......... .......... .......... .......... .......... 96% 38.5M 1s 144100K .......... .......... .......... .......... .......... 96% 11.2M 1s 144150K .......... .......... .......... .......... .......... 96% 25.9M 1s 144200K .......... .......... .......... .......... .......... 96% 22.2M 1s 144250K .......... .......... .......... .......... .......... 96% 34.3M 1s 144300K .......... .......... .......... .......... .......... 96% 19.3M 1s 144350K .......... .......... .......... .......... .......... 96% 45.5M 1s 144400K .......... .......... .......... .......... .......... 96% 42.5M 1s 144450K .......... .......... .......... .......... .......... 96% 44.2M 1s 144500K .......... .......... .......... .......... .......... 96% 53.9M 1s 144550K .......... .......... .......... .......... .......... 96% 44.7M 1s 144600K .......... .......... .......... .......... .......... 96% 9.27M 1s 144650K .......... .......... .......... .......... .......... 96% 7.40M 1s 144700K .......... .......... .......... .......... .......... 96% 40.1M 1s 144750K .......... .......... .......... .......... .......... 96% 8.76M 1s 144800K .......... .......... .......... .......... .......... 96% 20.8M 1s 144850K .......... .......... .......... .......... .......... 96% 33.9M 1s 144900K .......... .......... .......... .......... .......... 96% 885K 1s 144950K .......... .......... .......... .......... .......... 96% 32.8M 1s 145000K .......... .......... .......... .......... .......... 96% 1.20M 1s 145050K .......... .......... .......... .......... .......... 96% 21.7M 1s 145100K .......... .......... .......... .......... .......... 97% 46.4M 1s 145150K .......... .......... .......... .......... .......... 97% 7.19M 1s 145200K .......... .......... .......... .......... .......... 97% 27.2M 1s 145250K .......... .......... .......... .......... .......... 97% 46.2M 1s 145300K .......... .......... .......... .......... .......... 97% 8.91M 1s 145350K .......... .......... .......... .......... .......... 97% 47.8M 0s 145400K .......... .......... .......... .......... .......... 97% 35.2M 0s 145450K .......... .......... .......... .......... .......... 97% 21.9M 0s 145500K .......... .......... .......... .......... .......... 97% 15.6M 0s 145550K .......... .......... .......... .......... .......... 97% 18.0M 0s 145600K .......... .......... .......... .......... .......... 97% 14.3M 0s 145650K .......... .......... .......... .......... .......... 97% 24.4M 0s 145700K .......... .......... .......... .......... .......... 97% 22.8M 0s 145750K .......... .......... .......... .......... .......... 97% 30.1M 0s 145800K .......... .......... .......... .......... .......... 97% 30.4M 0s 145850K .......... .......... .......... .......... .......... 97% 21.3M 0s 145900K .......... .......... .......... .......... .......... 97% 45.3M 0s 145950K .......... .......... .......... .......... .......... 97% 45.9M 0s 146000K .......... .......... .......... .......... .......... 97% 42.2M 0s 146050K .......... .......... .......... .......... .......... 97% 44.8M 0s 146100K .......... .......... .......... .......... .......... 97% 44.9M 0s 146150K .......... .......... .......... .......... .......... 97% 8.94M 0s 146200K .......... .......... .......... .......... .......... 97% 6.54M 0s 146250K .......... .......... .......... .......... .......... 97% 11.4M 0s 146300K .......... .......... .......... .......... .......... 97% 38.4M 0s 146350K .......... .......... .......... .......... .......... 97% 15.6M 0s 146400K .......... .......... .......... .......... .......... 97% 71.5M 0s 146450K .......... .......... .......... .......... .......... 97% 873K 0s 146500K .......... .......... .......... .......... .......... 97% 1.23M 0s 146550K .......... .......... .......... .......... .......... 97% 20.8M 0s 146600K .......... .......... .......... .......... .......... 98% 27.6M 0s 146650K .......... .......... .......... .......... .......... 98% 9.73M 0s 146700K .......... .......... .......... .......... .......... 98% 18.2M 0s 146750K .......... .......... .......... .......... .......... 98% 27.5M 0s 146800K .......... .......... .......... .......... .......... 98% 11.9M 0s 146850K .......... .......... .......... .......... .......... 98% 19.9M 0s 146900K .......... .......... .......... .......... .......... 98% 42.6M 0s 146950K .......... .......... .......... .......... .......... 98% 32.6M 0s 147000K .......... .......... .......... .......... .......... 98% 10.6M 0s 147050K .......... .......... .......... .......... .......... 98% 22.9M 0s 147100K .......... .......... .......... .......... .......... 98% 21.2M 0s 147150K .......... .......... .......... .......... .......... 98% 16.1M 0s 147200K .......... .......... .......... .......... .......... 98% 27.7M 0s 147250K .......... .......... .......... .......... .......... 98% 23.9M 0s 147300K .......... .......... .......... .......... .......... 98% 24.7M 0s 147350K .......... .......... .......... .......... .......... 98% 22.6M 0s 147400K .......... .......... .......... .......... .......... 98% 47.7M 0s 147450K .......... .......... .......... .......... .......... 98% 45.4M 0s 147500K .......... .......... .......... .......... .......... 98% 37.4M 0s 147550K .......... .......... .......... .......... .......... 98% 20.5M 0s 147600K .......... .......... .......... .......... .......... 98% 45.1M 0s 147650K .......... .......... .......... .......... .......... 98% 17.0M 0s 147700K .......... .......... .......... .......... .......... 98% 9.34M 0s 147750K .......... .......... .......... .......... .......... 98% 8.54M 0s 147800K .......... .......... .......... .......... .......... 98% 12.1M 0s 147850K .......... .......... .......... .......... .......... 98% 37.9M 0s 147900K .......... .......... .......... .......... .......... 98% 20.4M 0s 147950K .......... .......... .......... .......... .......... 98% 1.20M 0s 148000K .......... .......... .......... .......... .......... 98% 2.88M 0s 148050K .......... .......... .......... .......... .......... 98% 1.23M 0s 148100K .......... .......... .......... .......... .......... 99% 16.1M 0s 148150K .......... .......... .......... .......... .......... 99% 43.6M 0s 148200K .......... .......... .......... .......... .......... 99% 9.34M 0s 148250K .......... .......... .......... .......... .......... 99% 16.0M 0s 148300K .......... .......... .......... .......... .......... 99% 36.5M 0s 148350K .......... .......... .......... .......... .......... 99% 5.91M 0s 148400K .......... .......... .......... .......... .......... 99% 30.5M 0s 148450K .......... .......... .......... .......... .......... 99% 36.0M 0s 148500K .......... .......... .......... .......... .......... 99% 32.3M 0s 148550K .......... .......... .......... .......... .......... 99% 23.4M 0s 148600K .......... .......... .......... .......... .......... 99% 23.4M 0s 148650K .......... .......... .......... .......... .......... 99% 35.7M 0s 148700K .......... .......... .......... .......... .......... 99% 14.7M 0s 148750K .......... .......... .......... .......... .......... 99% 34.7M 0s 148800K .......... .......... .......... .......... .......... 99% 11.9M 0s 148850K .......... .......... .......... .......... .......... 99% 41.5M 0s 148900K .......... .......... .......... .......... .......... 99% 38.8M 0s 148950K .......... .......... .......... .......... .......... 99% 48.7M 0s 149000K .......... .......... .......... .......... .......... 99% 43.4M 0s 149050K .......... .......... .......... .......... .......... 99% 38.0M 0s 149100K .......... .......... .......... .......... .......... 99% 20.7M 0s 149150K .......... .......... .......... .......... .......... 99% 46.0M 0s 149200K .......... .......... .......... .......... .......... 99% 11.8M 0s 149250K .......... .......... .......... .......... .......... 99% 5.91M 0s 149300K .......... .......... .......... .......... .......... 99% 35.9M 0s 149350K .......... .......... .......... .......... .......... 99% 12.9M 0s 149400K .......... .......... .......... .......... .......... 99% 32.5M 0s 149450K .......... .......... .......... .......... .......... 99% 19.5M 0s 149500K .......... .......... .......... .......... .......... 99% 893K 0s 149550K .......... .......... .......... .......... .......... 99% 1.26M 0s 149600K .......... .......... ...... 100% 19.8M=18s 2019-06-19 09:16:23 (8.27 MB/s) - ‘T-driveTaxiTrajectories.zip’ saved [153217794/153217794]
%sh
# Check that the file is there
ls -al
total 157912 drwxr-xr-x 1 root root 4096 Jun 19 09:16 . drwxr-xr-x 1 root root 4096 Jun 19 06:36 .. drwxr-xr-x 2 root root 4096 Jan 1 1970 conf -rw-r--r-- 1 root root 731 Jun 19 06:37 derby.log drwxr-xr-x 3 root root 4096 Jun 19 06:37 eventlogs drwxr-xr-x 2 root root 4096 Jun 19 09:15 ganglia drwxr-xr-x 2 root root 4096 Jun 19 06:37 library-install-logs drwxr-xr-x 2 root root 4096 Jun 19 09:02 logs -rw-r--r-- 1 root root 153217794 May 4 2018 T-driveTaxiTrajectories.zip -rw-r--r-- 1 root root 816717 Jun 19 08:18 TinyUppsalaCentrumWgot.osm -rw-r--r-- 1 root root 7628216 Jun 19 08:15 UppsalaCentrumWgot.osm
%sh
du -sh T-driveTaxiTrajectories.zip
147M T-driveTaxiTrajectories.zip

Below we illustrate the small files problem

Having lots of small files is bad for distributed file store as the metadata needed to store each small file starts to interefere with performance.

We show how to avoid this performance hit when naively loading lots of small files by concatenating them and loading a large file which automagically get chopped into optimally sized blocks when we load it into distributed file system dbfs in databricks (s3 on AWS).

%sh

# Ensure directory exists use '-p' flag to avoid directory already exists warning
mkdir /dbfs/files/trajectories

# This command will unzip the files, concatenate all the data to a single file, gzip it and then put this single file in dbfs.
# It takes about 3 minutes to run.

unzip -o T-driveTaxiTrajectories.zip
rm all.txt
cat release/taxi_log_2008_by_id/*.txt >> all.txt
gzip -k all.txt
cp all.txt.gz /dbfs/files/trajectories/  # or you can just wget http://lamastex.org/datasets/public/geospatial/msr/all.txt.gz
mkdir: cannot create directory ‘/dbfs/files/trajectories’: File exists Archive: T-driveTaxiTrajectories.zip inflating: release/taxi_log_2008_by_id/1.txt inflating: release/taxi_log_2008_by_id/10.txt inflating: release/taxi_log_2008_by_id/100.txt inflating: release/taxi_log_2008_by_id/1000.txt inflating: release/taxi_log_2008_by_id/10000.txt inflating: release/taxi_log_2008_by_id/10001.txt inflating: release/taxi_log_2008_by_id/10002.txt inflating: release/taxi_log_2008_by_id/10003.txt inflating: release/taxi_log_2008_by_id/10004.txt inflating: release/taxi_log_2008_by_id/10005.txt inflating: release/taxi_log_2008_by_id/10006.txt inflating: release/taxi_log_2008_by_id/10007.txt inflating: release/taxi_log_2008_by_id/10008.txt inflating: release/taxi_log_2008_by_id/10009.txt inflating: release/taxi_log_2008_by_id/1001.txt inflating: release/taxi_log_2008_by_id/10010.txt inflating: release/taxi_log_2008_by_id/10011.txt inflating: release/taxi_log_2008_by_id/10012.txt inflating: release/taxi_log_2008_by_id/10013.txt inflating: release/taxi_log_2008_by_id/10014.txt inflating: release/taxi_log_2008_by_id/10015.txt inflating: release/taxi_log_2008_by_id/10016.txt inflating: release/taxi_log_2008_by_id/10017.txt inflating: release/taxi_log_2008_by_id/10018.txt inflating: release/taxi_log_2008_by_id/10019.txt inflating: release/taxi_log_2008_by_id/1002.txt inflating: release/taxi_log_2008_by_id/10020.txt inflating: release/taxi_log_2008_by_id/10021.txt inflating: release/taxi_log_2008_by_id/10022.txt inflating: release/taxi_log_2008_by_id/10023.txt inflating: release/taxi_log_2008_by_id/10024.txt inflating: release/taxi_log_2008_by_id/10025.txt inflating: release/taxi_log_2008_by_id/10026.txt inflating: release/taxi_log_2008_by_id/10027.txt inflating: release/taxi_log_2008_by_id/10028.txt inflating: release/taxi_log_2008_by_id/10029.txt inflating: release/taxi_log_2008_by_id/1003.txt inflating: release/taxi_log_2008_by_id/10030.txt inflating: release/taxi_log_2008_by_id/10031.txt inflating: release/taxi_log_2008_by_id/10032.txt inflating: release/taxi_log_2008_by_id/10033.txt inflating: release/taxi_log_2008_by_id/10034.txt inflating: release/taxi_log_2008_by_id/10035.txt inflating: release/taxi_log_2008_by_id/10036.txt inflating: release/taxi_log_2008_by_id/10037.txt inflating: release/taxi_log_2008_by_id/10038.txt inflating: release/taxi_log_2008_by_id/10039.txt inflating: release/taxi_log_2008_by_id/1004.txt inflating: release/taxi_log_2008_by_id/10040.txt inflating: release/taxi_log_2008_by_id/10041.txt inflating: release/taxi_log_2008_by_id/10042.txt inflating: release/taxi_log_2008_by_id/10043.txt inflating: release/taxi_log_2008_by_id/10044.txt inflating: release/taxi_log_2008_by_id/10045.txt inflating: release/taxi_log_2008_by_id/10046.txt inflating: release/taxi_log_2008_by_id/10047.txt inflating: release/taxi_log_2008_by_id/10048.txt inflating: release/taxi_log_2008_by_id/10049.txt inflating: release/taxi_log_2008_by_id/1005.txt inflating: release/taxi_log_2008_by_id/10050.txt inflating: release/taxi_log_2008_by_id/10051.txt inflating: release/taxi_log_2008_by_id/10052.txt inflating: release/taxi_log_2008_by_id/10053.txt inflating: release/taxi_log_2008_by_id/10054.txt inflating: release/taxi_log_2008_by_id/10055.txt inflating: release/taxi_log_2008_by_id/10056.txt inflating: release/taxi_log_2008_by_id/10057.txt inflating: release/taxi_log_2008_by_id/10058.txt inflating: release/taxi_log_2008_by_id/10059.txt inflating: release/taxi_log_2008_by_id/1006.txt inflating: release/taxi_log_2008_by_id/10060.txt inflating: release/taxi_log_2008_by_id/10061.txt inflating: release/taxi_log_2008_by_id/10062.txt inflating: release/taxi_log_2008_by_id/10063.txt inflating: release/taxi_log_2008_by_id/10064.txt inflating: release/taxi_log_2008_by_id/10065.txt inflating: release/taxi_log_2008_by_id/10066.txt inflating: release/taxi_log_2008_by_id/10067.txt inflating: release/taxi_log_2008_by_id/10068.txt inflating: release/taxi_log_2008_by_id/10069.txt inflating: release/taxi_log_2008_by_id/1007.txt inflating: release/taxi_log_2008_by_id/10070.txt inflating: release/taxi_log_2008_by_id/10071.txt inflating: release/taxi_log_2008_by_id/10072.txt inflating: release/taxi_log_2008_by_id/10073.txt inflating: release/taxi_log_2008_by_id/10074.txt inflating: release/taxi_log_2008_by_id/10075.txt inflating: release/taxi_log_2008_by_id/10076.txt inflating: release/taxi_log_2008_by_id/10077.txt inflating: release/taxi_log_2008_by_id/10078.txt inflating: release/taxi_log_2008_by_id/10079.txt inflating: release/taxi_log_2008_by_id/1008.txt inflating: release/taxi_log_2008_by_id/10080.txt inflating: release/taxi_log_2008_by_id/10081.txt inflating: release/taxi_log_2008_by_id/10082.txt inflating: release/taxi_log_2008_by_id/10083.txt inflating: release/taxi_log_2008_by_id/10084.txt inflating: release/taxi_log_2008_by_id/10085.txt inflating: release/taxi_log_2008_by_id/10086.txt inflating: release/taxi_log_2008_by_id/10087.txt inflating: release/taxi_log_2008_by_id/10088.txt inflating: release/taxi_log_2008_by_id/10089.txt inflating: release/taxi_log_2008_by_id/1009.txt inflating: release/taxi_log_2008_by_id/10090.txt inflating: release/taxi_log_2008_by_id/10091.txt inflating: release/taxi_log_2008_by_id/10092.txt inflating: release/taxi_log_2008_by_id/10093.txt inflating: release/taxi_log_2008_by_id/10094.txt inflating: release/taxi_log_2008_by_id/10095.txt inflating: release/taxi_log_2008_by_id/10096.txt inflating: release/taxi_log_2008_by_id/10097.txt inflating: release/taxi_log_2008_by_id/10098.txt inflating: release/taxi_log_2008_by_id/10099.txt inflating: release/taxi_log_2008_by_id/101.txt inflating: release/taxi_log_2008_by_id/1010.txt inflating: release/taxi_log_2008_by_id/10100.txt inflating: release/taxi_log_2008_by_id/10101.txt inflating: release/taxi_log_2008_by_id/10102.txt inflating: release/taxi_log_2008_by_id/10103.txt inflating: release/taxi_log_2008_by_id/10104.txt inflating: release/taxi_log_2008_by_id/10105.txt inflating: release/taxi_log_2008_by_id/10106.txt inflating: release/taxi_log_2008_by_id/10107.txt inflating: release/taxi_log_2008_by_id/10108.txt inflating: release/taxi_log_2008_by_id/10109.txt inflating: release/taxi_log_2008_by_id/1011.txt inflating: release/taxi_log_2008_by_id/10110.txt inflating: release/taxi_log_2008_by_id/10111.txt inflating: release/taxi_log_2008_by_id/10112.txt inflating: release/taxi_log_2008_by_id/10113.txt inflating: release/taxi_log_2008_by_id/10114.txt extracting: release/taxi_log_2008_by_id/10115.txt inflating: release/taxi_log_2008_by_id/10116.txt inflating: release/taxi_log_2008_by_id/10117.txt inflating: release/taxi_log_2008_by_id/10118.txt inflating: release/taxi_log_2008_by_id/10119.txt inflating: release/taxi_log_2008_by_id/1012.txt inflating: release/taxi_log_2008_by_id/10120.txt inflating: release/taxi_log_2008_by_id/10121.txt inflating: release/taxi_log_2008_by_id/10122.txt inflating: release/taxi_log_2008_by_id/10123.txt inflating: release/taxi_log_2008_by_id/10124.txt inflating: release/taxi_log_2008_by_id/10125.txt inflating: release/taxi_log_2008_by_id/10126.txt inflating: release/taxi_log_2008_by_id/10127.txt inflating: release/taxi_log_2008_by_id/10128.txt inflating: release/taxi_log_2008_by_id/10129.txt inflating: release/taxi_log_2008_by_id/1013.txt inflating: release/taxi_log_2008_by_id/10130.txt inflating: release/taxi_log_2008_by_id/10131.txt inflating: release/taxi_log_2008_by_id/10132.txt inflating: release/taxi_log_2008_by_id/10133.txt inflating: release/taxi_log_2008_by_id/10134.txt inflating: release/taxi_log_2008_by_id/10135.txt inflating: release/taxi_log_2008_by_id/10136.txt inflating: release/taxi_log_2008_by_id/10137.txt inflating: release/taxi_log_2008_by_id/10138.txt inflating: release/taxi_log_2008_by_id/10139.txt inflating: release/taxi_log_2008_by_id/1014.txt inflating: release/taxi_log_2008_by_id/10140.txt inflating: release/taxi_log_2008_by_id/10141.txt inflating: release/taxi_log_2008_by_id/10142.txt inflating: release/taxi_log_2008_by_id/10143.txt inflating: release/taxi_log_2008_by_id/10144.txt inflating: release/taxi_log_2008_by_id/10145.txt inflating: release/taxi_log_2008_by_id/10146.txt inflating: release/taxi_log_2008_by_id/10147.txt inflating: release/taxi_log_2008_by_id/10148.txt inflating: release/taxi_log_2008_by_id/10149.txt inflating: release/taxi_log_2008_by_id/1015.txt inflating: release/taxi_log_2008_by_id/10150.txt inflating: release/taxi_log_2008_by_id/10151.txt inflating: release/taxi_log_2008_by_id/10152.txt inflating: release/taxi_log_2008_by_id/10153.txt inflating: release/taxi_log_2008_by_id/10154.txt inflating: release/taxi_log_2008_by_id/10155.txt inflating: release/taxi_log_2008_by_id/10156.txt inflating: release/taxi_log_2008_by_id/10157.txt inflating: release/taxi_log_2008_by_id/10158.txt inflating: release/taxi_log_2008_by_id/10159.txt inflating: release/taxi_log_2008_by_id/1016.txt inflating: release/taxi_log_2008_by_id/10160.txt inflating: release/taxi_log_2008_by_id/10161.txt inflating: release/taxi_log_2008_by_id/10162.txt inflating: release/taxi_log_2008_by_id/10163.txt inflating: release/taxi_log_2008_by_id/10164.txt inflating: release/taxi_log_2008_by_id/10165.txt inflating: release/taxi_log_2008_by_id/10166.txt inflating: release/taxi_log_2008_by_id/10167.txt inflating: release/taxi_log_2008_by_id/10168.txt inflating: release/taxi_log_2008_by_id/10169.txt inflating: release/taxi_log_2008_by_id/1017.txt inflating: release/taxi_log_2008_by_id/10170.txt inflating: release/taxi_log_2008_by_id/10171.txt inflating: release/taxi_log_2008_by_id/10172.txt inflating: release/taxi_log_2008_by_id/10173.txt inflating: release/taxi_log_2008_by_id/10174.txt inflating: release/taxi_log_2008_by_id/10175.txt inflating: release/taxi_log_2008_by_id/10176.txt inflating: release/taxi_log_2008_by_id/10177.txt inflating: release/taxi_log_2008_by_id/10178.txt inflating: release/taxi_log_2008_by_id/10179.txt inflating: release/taxi_log_2008_by_id/1018.txt inflating: release/taxi_log_2008_by_id/10180.txt inflating: release/taxi_log_2008_by_id/10181.txt inflating: release/taxi_log_2008_by_id/10182.txt inflating: release/taxi_log_2008_by_id/10183.txt inflating: release/taxi_log_2008_by_id/10184.txt inflating: release/taxi_log_2008_by_id/10185.txt inflating: release/taxi_log_2008_by_id/10186.txt inflating: release/taxi_log_2008_by_id/10187.txt inflating: release/taxi_log_2008_by_id/10188.txt inflating: release/taxi_log_2008_by_id/10189.txt inflating: release/taxi_log_2008_by_id/1019.txt inflating: release/taxi_log_2008_by_id/10190.txt inflating: release/taxi_log_2008_by_id/10191.txt inflating: release/taxi_log_2008_by_id/10192.txt inflating: release/taxi_log_2008_by_id/10193.txt inflating: release/taxi_log_2008_by_id/10194.txt inflating: release/taxi_log_2008_by_id/10195.txt inflating: release/taxi_log_2008_by_id/10196.txt inflating: release/taxi_log_2008_by_id/10197.txt inflating: release/taxi_log_2008_by_id/10198.txt inflating: release/taxi_log_2008_by_id/10199.txt inflating: release/taxi_log_2008_by_id/102.txt inflating: release/taxi_log_2008_by_id/1020.txt inflating: release/taxi_log_2008_by_id/10200.txt inflating: release/taxi_log_2008_by_id/10201.txt inflating: release/taxi_log_2008_by_id/10202.txt inflating: release/taxi_log_2008_by_id/10203.txt inflating: release/taxi_log_2008_by_id/10204.txt inflating: release/taxi_log_2008_by_id/10205.txt inflating: release/taxi_log_2008_by_id/10206.txt inflating: release/taxi_log_2008_by_id/10207.txt inflating: release/taxi_log_2008_by_id/10208.txt inflating: release/taxi_log_2008_by_id/10209.txt inflating: release/taxi_log_2008_by_id/1021.txt inflating: release/taxi_log_2008_by_id/10210.txt inflating: release/taxi_log_2008_by_id/10211.txt inflating: release/taxi_log_2008_by_id/10212.txt inflating: release/taxi_log_2008_by_id/10213.txt inflating: release/taxi_log_2008_by_id/10214.txt inflating: release/taxi_log_2008_by_id/10215.txt inflating: release/taxi_log_2008_by_id/10216.txt inflating: release/taxi_log_2008_by_id/10217.txt inflating: release/taxi_log_2008_by_id/10218.txt inflating: release/taxi_log_2008_by_id/10219.txt inflating: release/taxi_log_2008_by_id/1022.txt inflating: release/taxi_log_2008_by_id/10220.txt inflating: release/taxi_log_2008_by_id/10221.txt inflating: release/taxi_log_2008_by_id/10222.txt inflating: release/taxi_log_2008_by_id/10223.txt inflating: release/taxi_log_2008_by_id/10224.txt inflating: release/taxi_log_2008_by_id/10225.txt inflating: release/taxi_log_2008_by_id/10226.txt inflating: release/taxi_log_2008_by_id/10227.txt inflating: release/taxi_log_2008_by_id/10228.txt inflating: release/taxi_log_2008_by_id/10229.txt inflating: release/taxi_log_2008_by_id/1023.txt inflating: release/taxi_log_2008_by_id/10230.txt inflating: release/taxi_log_2008_by_id/10231.txt inflating: release/taxi_log_2008_by_id/10232.txt inflating: release/taxi_log_2008_by_id/10233.txt inflating: release/taxi_log_2008_by_id/10234.txt inflating: release/taxi_log_2008_by_id/10235.txt inflating: release/taxi_log_2008_by_id/10236.txt inflating: release/taxi_log_2008_by_id/10237.txt inflating: release/taxi_log_2008_by_id/10238.txt inflating: release/taxi_log_2008_by_id/10239.txt inflating: release/taxi_log_2008_by_id/1024.txt extracting: release/taxi_log_2008_by_id/10240.txt inflating: release/taxi_log_2008_by_id/10241.txt inflating: release/taxi_log_2008_by_id/10242.txt inflating: release/taxi_log_2008_by_id/10243.txt inflating: release/taxi_log_2008_by_id/10244.txt inflating: release/taxi_log_2008_by_id/10245.txt inflating: release/taxi_log_2008_by_id/10246.txt inflating: release/taxi_log_2008_by_id/10247.txt inflating: release/taxi_log_2008_by_id/10248.txt inflating: release/taxi_log_2008_by_id/10249.txt inflating: release/taxi_log_2008_by_id/1025.txt inflating: release/taxi_log_2008_by_id/10250.txt inflating: release/taxi_log_2008_by_id/10251.txt inflating: release/taxi_log_2008_by_id/10252.txt inflating: release/taxi_log_2008_by_id/10253.txt inflating: release/taxi_log_2008_by_id/10254.txt inflating: release/taxi_log_2008_by_id/10255.txt inflating: release/taxi_log_2008_by_id/10256.txt inflating: release/taxi_log_2008_by_id/10257.txt inflating: release/taxi_log_2008_by_id/10258.txt inflating: release/taxi_log_2008_by_id/10259.txt inflating: release/taxi_log_2008_by_id/1026.txt inflating: release/taxi_log_2008_by_id/10260.txt inflating: release/taxi_log_2008_by_id/10261.txt inflating: release/taxi_log_2008_by_id/10262.txt inflating: release/taxi_log_2008_by_id/10263.txt extracting: release/taxi_log_2008_by_id/10264.txt inflating: release/taxi_log_2008_by_id/10265.txt inflating: release/taxi_log_2008_by_id/10266.txt inflating: release/taxi_log_2008_by_id/10267.txt inflating: release/taxi_log_2008_by_id/10268.txt inflating: release/taxi_log_2008_by_id/10269.txt inflating: release/taxi_log_2008_by_id/1027.txt inflating: release/taxi_log_2008_by_id/10270.txt inflating: release/taxi_log_2008_by_id/10271.txt inflating: release/taxi_log_2008_by_id/10272.txt inflating: release/taxi_log_2008_by_id/10273.txt inflating: release/taxi_log_2008_by_id/10274.txt inflating: release/taxi_log_2008_by_id/10275.txt inflating: release/taxi_log_2008_by_id/10276.txt inflating: release/taxi_log_2008_by_id/10277.txt inflating: release/taxi_log_2008_by_id/10278.txt inflating: release/taxi_log_2008_by_id/10279.txt inflating: release/taxi_log_2008_by_id/1028.txt inflating: release/taxi_log_2008_by_id/10280.txt inflating: release/taxi_log_2008_by_id/10281.txt inflating: release/taxi_log_2008_by_id/10282.txt inflating: release/taxi_log_2008_by_id/10283.txt inflating: release/taxi_log_2008_by_id/10284.txt inflating: release/taxi_log_2008_by_id/10285.txt inflating: release/taxi_log_2008_by_id/10286.txt inflating: release/taxi_log_2008_by_id/10287.txt inflating: release/taxi_log_2008_by_id/10288.txt inflating: release/taxi_log_2008_by_id/10289.txt inflating: release/taxi_log_2008_by_id/1029.txt inflating: release/taxi_log_2008_by_id/10290.txt inflating: release/taxi_log_2008_by_id/10291.txt inflating: release/taxi_log_2008_by_id/10292.txt inflating: release/taxi_log_2008_by_id/10293.txt inflating: release/taxi_log_2008_by_id/10294.txt inflating: release/taxi_log_2008_by_id/10295.txt inflating: release/taxi_log_2008_by_id/10296.txt inflating: release/taxi_log_2008_by_id/10297.txt inflating: release/taxi_log_2008_by_id/10298.txt inflating: release/taxi_log_2008_by_id/10299.txt inflating: release/taxi_log_2008_by_id/103.txt inflating: release/taxi_log_2008_by_id/1030.txt inflating: release/taxi_log_2008_by_id/10300.txt inflating: release/taxi_log_2008_by_id/10301.txt inflating: release/taxi_log_2008_by_id/10302.txt inflating: release/taxi_log_2008_by_id/10303.txt inflating: release/taxi_log_2008_by_id/10304.txt inflating: release/taxi_log_2008_by_id/10305.txt inflating: release/taxi_log_2008_by_id/10306.txt inflating: release/taxi_log_2008_by_id/10307.txt inflating: release/taxi_log_2008_by_id/10308.txt inflating: release/taxi_log_2008_by_id/10309.txt inflating: release/taxi_log_2008_by_id/1031.txt inflating: release/taxi_log_2008_by_id/10310.txt inflating: release/taxi_log_2008_by_id/10311.txt inflating: release/taxi_log_2008_by_id/10312.txt inflating: release/taxi_log_2008_by_id/10313.txt inflating: release/taxi_log_2008_by_id/10314.txt inflating: release/taxi_log_2008_by_id/10315.txt inflating: release/taxi_log_2008_by_id/10316.txt inflating: release/taxi_log_2008_by_id/10317.txt inflating: release/taxi_log_2008_by_id/10318.txt inflating: release/taxi_log_2008_by_id/10319.txt inflating: release/taxi_log_2008_by_id/1032.txt inflating: release/taxi_log_2008_by_id/10320.txt inflating: release/taxi_log_2008_by_id/10321.txt inflating: release/taxi_log_2008_by_id/10322.txt inflating: release/taxi_log_2008_by_id/10323.txt inflating: release/taxi_log_2008_by_id/10324.txt inflating: release/taxi_log_2008_by_id/10325.txt inflating: release/taxi_log_2008_by_id/10326.txt inflating: release/taxi_log_2008_by_id/10327.txt inflating: release/taxi_log_2008_by_id/10328.txt inflating: release/taxi_log_2008_by_id/10329.txt inflating: release/taxi_log_2008_by_id/1033.txt inflating: release/taxi_log_2008_by_id/10330.txt inflating: release/taxi_log_2008_by_id/10331.txt inflating: release/taxi_log_2008_by_id/10332.txt inflating: release/taxi_log_2008_by_id/10333.txt inflating: release/taxi_log_2008_by_id/10334.txt inflating: release/taxi_log_2008_by_id/10335.txt inflating: release/taxi_log_2008_by_id/10336.txt inflating: release/taxi_log_2008_by_id/10337.txt inflating: release/taxi_log_2008_by_id/10338.txt inflating: release/taxi_log_2008_by_id/10339.txt inflating: release/taxi_log_2008_by_id/1034.txt inflating: release/taxi_log_2008_by_id/10340.txt inflating: release/taxi_log_2008_by_id/10341.txt inflating: release/taxi_log_2008_by_id/10342.txt inflating: release/taxi_log_2008_by_id/10343.txt inflating: release/taxi_log_2008_by_id/10344.txt inflating: release/taxi_log_2008_by_id/10345.txt inflating: release/taxi_log_2008_by_id/10346.txt inflating: release/taxi_log_2008_by_id/10347.txt inflating: release/taxi_log_2008_by_id/10348.txt inflating: release/taxi_log_2008_by_id/10349.txt inflating: release/taxi_log_2008_by_id/1035.txt inflating: release/taxi_log_2008_by_id/10350.txt inflating: release/taxi_log_2008_by_id/10351.txt extracting: release/taxi_log_2008_by_id/10352.txt inflating: release/taxi_log_2008_by_id/10353.txt inflating: release/taxi_log_2008_by_id/10354.txt inflating: release/taxi_log_2008_by_id/10355.txt inflating: release/taxi_log_2008_by_id/10356.txt inflating: release/taxi_log_2008_by_id/10357.txt inflating: release/taxi_log_2008_by_id/1036.txt inflating: release/taxi_log_2008_by_id/1037.txt inflating: release/taxi_log_2008_by_id/1038.txt inflating: release/taxi_log_2008_by_id/1039.txt inflating: release/taxi_log_2008_by_id/104.txt inflating: release/taxi_log_2008_by_id/1040.txt inflating: release/taxi_log_2008_by_id/1041.txt inflating: release/taxi_log_2008_by_id/1042.txt inflating: release/taxi_log_2008_by_id/1043.txt inflating: release/taxi_log_2008_by_id/1044.txt inflating: release/taxi_log_2008_by_id/1045.txt inflating: release/taxi_log_2008_by_id/1046.txt inflating: release/taxi_log_2008_by_id/1047.txt inflating: release/taxi_log_2008_by_id/1048.txt inflating: release/taxi_log_2008_by_id/1049.txt inflating: release/taxi_log_2008_by_id/105.txt inflating: release/taxi_log_2008_by_id/1050.txt inflating: release/taxi_log_2008_by_id/1051.txt inflating: release/taxi_log_2008_by_id/1052.txt inflating: release/taxi_log_2008_by_id/1053.txt inflating: release/taxi_log_2008_by_id/1054.txt inflating: release/taxi_log_2008_by_id/1055.txt inflating: release/taxi_log_2008_by_id/1056.txt inflating: release/taxi_log_2008_by_id/1057.txt inflating: release/taxi_log_2008_by_id/1058.txt inflating: release/taxi_log_2008_by_id/1059.txt inflating: release/taxi_log_2008_by_id/106.txt inflating: release/taxi_log_2008_by_id/1060.txt inflating: release/taxi_log_2008_by_id/1061.txt inflating: release/taxi_log_2008_by_id/1062.txt inflating: release/taxi_log_2008_by_id/1063.txt inflating: release/taxi_log_2008_by_id/1064.txt inflating: release/taxi_log_2008_by_id/1065.txt inflating: release/taxi_log_2008_by_id/1066.txt inflating: release/taxi_log_2008_by_id/1067.txt inflating: release/taxi_log_2008_by_id/1068.txt inflating: release/taxi_log_2008_by_id/1069.txt inflating: release/taxi_log_2008_by_id/107.txt inflating: release/taxi_log_2008_by_id/1070.txt inflating: release/taxi_log_2008_by_id/1071.txt inflating: release/taxi_log_2008_by_id/1072.txt inflating: release/taxi_log_2008_by_id/1073.txt inflating: release/taxi_log_2008_by_id/1074.txt inflating: release/taxi_log_2008_by_id/1075.txt inflating: release/taxi_log_2008_by_id/1076.txt inflating: release/taxi_log_2008_by_id/1077.txt inflating: release/taxi_log_2008_by_id/1078.txt inflating: release/taxi_log_2008_by_id/1079.txt inflating: release/taxi_log_2008_by_id/108.txt inflating: release/taxi_log_2008_by_id/1080.txt inflating: release/taxi_log_2008_by_id/1081.txt inflating: release/taxi_log_2008_by_id/1082.txt inflating: release/taxi_log_2008_by_id/1083.txt inflating: release/taxi_log_2008_by_id/1084.txt inflating: release/taxi_log_2008_by_id/1085.txt inflating: release/taxi_log_2008_by_id/1086.txt inflating: release/taxi_log_2008_by_id/1087.txt inflating: release/taxi_log_2008_by_id/1088.txt extracting: release/taxi_log_2008_by_id/1089.txt inflating: release/taxi_log_2008_by_id/109.txt inflating: release/taxi_log_2008_by_id/1090.txt inflating: release/taxi_log_2008_by_id/1091.txt inflating: release/taxi_log_2008_by_id/1092.txt inflating: release/taxi_log_2008_by_id/1093.txt inflating: release/taxi_log_2008_by_id/1094.txt inflating: release/taxi_log_2008_by_id/1095.txt inflating: release/taxi_log_2008_by_id/1096.txt inflating: release/taxi_log_2008_by_id/1097.txt inflating: release/taxi_log_2008_by_id/1098.txt inflating: release/taxi_log_2008_by_id/1099.txt inflating: release/taxi_log_2008_by_id/11.txt inflating: release/taxi_log_2008_by_id/110.txt inflating: release/taxi_log_2008_by_id/1100.txt *** WARNING: skipped 488022 bytes of output *** inflating: release/taxi_log_2008_by_id/9568.txt inflating: release/taxi_log_2008_by_id/9569.txt inflating: release/taxi_log_2008_by_id/957.txt inflating: release/taxi_log_2008_by_id/9570.txt inflating: release/taxi_log_2008_by_id/9571.txt inflating: release/taxi_log_2008_by_id/9572.txt inflating: release/taxi_log_2008_by_id/9573.txt inflating: release/taxi_log_2008_by_id/9574.txt inflating: release/taxi_log_2008_by_id/9575.txt inflating: release/taxi_log_2008_by_id/9576.txt inflating: release/taxi_log_2008_by_id/9577.txt inflating: release/taxi_log_2008_by_id/9578.txt inflating: release/taxi_log_2008_by_id/9579.txt inflating: release/taxi_log_2008_by_id/958.txt inflating: release/taxi_log_2008_by_id/9580.txt inflating: release/taxi_log_2008_by_id/9581.txt inflating: release/taxi_log_2008_by_id/9582.txt inflating: release/taxi_log_2008_by_id/9583.txt inflating: release/taxi_log_2008_by_id/9584.txt inflating: release/taxi_log_2008_by_id/9585.txt inflating: release/taxi_log_2008_by_id/9586.txt inflating: release/taxi_log_2008_by_id/9587.txt inflating: release/taxi_log_2008_by_id/9588.txt inflating: release/taxi_log_2008_by_id/9589.txt inflating: release/taxi_log_2008_by_id/959.txt inflating: release/taxi_log_2008_by_id/9590.txt inflating: release/taxi_log_2008_by_id/9591.txt inflating: release/taxi_log_2008_by_id/9592.txt inflating: release/taxi_log_2008_by_id/9593.txt inflating: release/taxi_log_2008_by_id/9594.txt inflating: release/taxi_log_2008_by_id/9595.txt inflating: release/taxi_log_2008_by_id/9596.txt inflating: release/taxi_log_2008_by_id/9597.txt inflating: release/taxi_log_2008_by_id/9598.txt inflating: release/taxi_log_2008_by_id/9599.txt inflating: release/taxi_log_2008_by_id/96.txt inflating: release/taxi_log_2008_by_id/960.txt inflating: release/taxi_log_2008_by_id/9600.txt inflating: release/taxi_log_2008_by_id/9601.txt inflating: release/taxi_log_2008_by_id/9602.txt inflating: release/taxi_log_2008_by_id/9603.txt inflating: release/taxi_log_2008_by_id/9604.txt inflating: release/taxi_log_2008_by_id/9605.txt inflating: release/taxi_log_2008_by_id/9606.txt inflating: release/taxi_log_2008_by_id/9607.txt inflating: release/taxi_log_2008_by_id/9608.txt inflating: release/taxi_log_2008_by_id/9609.txt inflating: release/taxi_log_2008_by_id/961.txt inflating: release/taxi_log_2008_by_id/9610.txt inflating: release/taxi_log_2008_by_id/9611.txt inflating: release/taxi_log_2008_by_id/9612.txt inflating: release/taxi_log_2008_by_id/9613.txt inflating: release/taxi_log_2008_by_id/9614.txt inflating: release/taxi_log_2008_by_id/9615.txt inflating: release/taxi_log_2008_by_id/9616.txt inflating: release/taxi_log_2008_by_id/9617.txt inflating: release/taxi_log_2008_by_id/9618.txt inflating: release/taxi_log_2008_by_id/9619.txt inflating: release/taxi_log_2008_by_id/962.txt inflating: release/taxi_log_2008_by_id/9620.txt inflating: release/taxi_log_2008_by_id/9621.txt inflating: release/taxi_log_2008_by_id/9622.txt inflating: release/taxi_log_2008_by_id/9623.txt inflating: release/taxi_log_2008_by_id/9624.txt inflating: release/taxi_log_2008_by_id/9625.txt inflating: release/taxi_log_2008_by_id/9626.txt inflating: release/taxi_log_2008_by_id/9627.txt inflating: release/taxi_log_2008_by_id/9628.txt inflating: release/taxi_log_2008_by_id/9629.txt inflating: release/taxi_log_2008_by_id/963.txt inflating: release/taxi_log_2008_by_id/9630.txt inflating: release/taxi_log_2008_by_id/9631.txt inflating: release/taxi_log_2008_by_id/9632.txt inflating: release/taxi_log_2008_by_id/9633.txt inflating: release/taxi_log_2008_by_id/9634.txt inflating: release/taxi_log_2008_by_id/9635.txt inflating: release/taxi_log_2008_by_id/9636.txt inflating: release/taxi_log_2008_by_id/9637.txt inflating: release/taxi_log_2008_by_id/9638.txt inflating: release/taxi_log_2008_by_id/9639.txt inflating: release/taxi_log_2008_by_id/964.txt inflating: release/taxi_log_2008_by_id/9640.txt inflating: release/taxi_log_2008_by_id/9641.txt inflating: release/taxi_log_2008_by_id/9642.txt inflating: release/taxi_log_2008_by_id/9643.txt inflating: release/taxi_log_2008_by_id/9644.txt inflating: release/taxi_log_2008_by_id/9645.txt inflating: release/taxi_log_2008_by_id/9646.txt inflating: release/taxi_log_2008_by_id/9647.txt inflating: release/taxi_log_2008_by_id/9648.txt inflating: release/taxi_log_2008_by_id/9649.txt inflating: release/taxi_log_2008_by_id/965.txt inflating: release/taxi_log_2008_by_id/9650.txt inflating: release/taxi_log_2008_by_id/9651.txt inflating: release/taxi_log_2008_by_id/9652.txt inflating: release/taxi_log_2008_by_id/9653.txt inflating: release/taxi_log_2008_by_id/9654.txt inflating: release/taxi_log_2008_by_id/9655.txt inflating: release/taxi_log_2008_by_id/9656.txt inflating: release/taxi_log_2008_by_id/9657.txt inflating: release/taxi_log_2008_by_id/9658.txt inflating: release/taxi_log_2008_by_id/9659.txt inflating: release/taxi_log_2008_by_id/966.txt inflating: release/taxi_log_2008_by_id/9660.txt inflating: release/taxi_log_2008_by_id/9661.txt inflating: release/taxi_log_2008_by_id/9662.txt inflating: release/taxi_log_2008_by_id/9663.txt inflating: release/taxi_log_2008_by_id/9664.txt inflating: release/taxi_log_2008_by_id/9665.txt inflating: release/taxi_log_2008_by_id/9666.txt inflating: release/taxi_log_2008_by_id/9667.txt inflating: release/taxi_log_2008_by_id/9668.txt inflating: release/taxi_log_2008_by_id/9669.txt inflating: release/taxi_log_2008_by_id/967.txt inflating: release/taxi_log_2008_by_id/9670.txt inflating: release/taxi_log_2008_by_id/9671.txt inflating: release/taxi_log_2008_by_id/9672.txt inflating: release/taxi_log_2008_by_id/9673.txt inflating: release/taxi_log_2008_by_id/9674.txt inflating: release/taxi_log_2008_by_id/9675.txt inflating: release/taxi_log_2008_by_id/9676.txt inflating: release/taxi_log_2008_by_id/9677.txt inflating: release/taxi_log_2008_by_id/9678.txt inflating: release/taxi_log_2008_by_id/9679.txt inflating: release/taxi_log_2008_by_id/968.txt inflating: release/taxi_log_2008_by_id/9680.txt inflating: release/taxi_log_2008_by_id/9681.txt inflating: release/taxi_log_2008_by_id/9682.txt inflating: release/taxi_log_2008_by_id/9683.txt inflating: release/taxi_log_2008_by_id/9684.txt inflating: release/taxi_log_2008_by_id/9685.txt inflating: release/taxi_log_2008_by_id/9686.txt inflating: release/taxi_log_2008_by_id/9687.txt inflating: release/taxi_log_2008_by_id/9688.txt inflating: release/taxi_log_2008_by_id/9689.txt inflating: release/taxi_log_2008_by_id/969.txt inflating: release/taxi_log_2008_by_id/9690.txt inflating: release/taxi_log_2008_by_id/9691.txt inflating: release/taxi_log_2008_by_id/9692.txt inflating: release/taxi_log_2008_by_id/9693.txt inflating: release/taxi_log_2008_by_id/9694.txt inflating: release/taxi_log_2008_by_id/9695.txt inflating: release/taxi_log_2008_by_id/9696.txt inflating: release/taxi_log_2008_by_id/9697.txt inflating: release/taxi_log_2008_by_id/9698.txt inflating: release/taxi_log_2008_by_id/9699.txt inflating: release/taxi_log_2008_by_id/97.txt inflating: release/taxi_log_2008_by_id/970.txt inflating: release/taxi_log_2008_by_id/9700.txt inflating: release/taxi_log_2008_by_id/9701.txt inflating: release/taxi_log_2008_by_id/9702.txt inflating: release/taxi_log_2008_by_id/9703.txt inflating: release/taxi_log_2008_by_id/9704.txt inflating: release/taxi_log_2008_by_id/9705.txt inflating: release/taxi_log_2008_by_id/9706.txt inflating: release/taxi_log_2008_by_id/9707.txt inflating: release/taxi_log_2008_by_id/9708.txt inflating: release/taxi_log_2008_by_id/9709.txt inflating: release/taxi_log_2008_by_id/971.txt inflating: release/taxi_log_2008_by_id/9710.txt inflating: release/taxi_log_2008_by_id/9711.txt inflating: release/taxi_log_2008_by_id/9712.txt inflating: release/taxi_log_2008_by_id/9713.txt inflating: release/taxi_log_2008_by_id/9714.txt inflating: release/taxi_log_2008_by_id/9715.txt inflating: release/taxi_log_2008_by_id/9716.txt inflating: release/taxi_log_2008_by_id/9717.txt inflating: release/taxi_log_2008_by_id/9718.txt inflating: release/taxi_log_2008_by_id/9719.txt inflating: release/taxi_log_2008_by_id/972.txt inflating: release/taxi_log_2008_by_id/9720.txt inflating: release/taxi_log_2008_by_id/9721.txt inflating: release/taxi_log_2008_by_id/9722.txt inflating: release/taxi_log_2008_by_id/9723.txt inflating: release/taxi_log_2008_by_id/9724.txt inflating: release/taxi_log_2008_by_id/9725.txt inflating: release/taxi_log_2008_by_id/9726.txt inflating: release/taxi_log_2008_by_id/9727.txt inflating: release/taxi_log_2008_by_id/9728.txt inflating: release/taxi_log_2008_by_id/9729.txt inflating: release/taxi_log_2008_by_id/973.txt inflating: release/taxi_log_2008_by_id/9730.txt inflating: release/taxi_log_2008_by_id/9731.txt inflating: release/taxi_log_2008_by_id/9732.txt inflating: release/taxi_log_2008_by_id/9733.txt inflating: release/taxi_log_2008_by_id/9734.txt inflating: release/taxi_log_2008_by_id/9735.txt inflating: release/taxi_log_2008_by_id/9736.txt inflating: release/taxi_log_2008_by_id/9737.txt inflating: release/taxi_log_2008_by_id/9738.txt inflating: release/taxi_log_2008_by_id/9739.txt inflating: release/taxi_log_2008_by_id/974.txt inflating: release/taxi_log_2008_by_id/9740.txt inflating: release/taxi_log_2008_by_id/9741.txt inflating: release/taxi_log_2008_by_id/9742.txt inflating: release/taxi_log_2008_by_id/9743.txt inflating: release/taxi_log_2008_by_id/9744.txt inflating: release/taxi_log_2008_by_id/9745.txt inflating: release/taxi_log_2008_by_id/9746.txt inflating: release/taxi_log_2008_by_id/9747.txt inflating: release/taxi_log_2008_by_id/9748.txt inflating: release/taxi_log_2008_by_id/9749.txt inflating: release/taxi_log_2008_by_id/975.txt inflating: release/taxi_log_2008_by_id/9750.txt inflating: release/taxi_log_2008_by_id/9751.txt inflating: release/taxi_log_2008_by_id/9752.txt inflating: release/taxi_log_2008_by_id/9753.txt inflating: release/taxi_log_2008_by_id/9754.txt inflating: release/taxi_log_2008_by_id/9755.txt inflating: release/taxi_log_2008_by_id/9756.txt inflating: release/taxi_log_2008_by_id/9757.txt inflating: release/taxi_log_2008_by_id/9758.txt inflating: release/taxi_log_2008_by_id/9759.txt inflating: release/taxi_log_2008_by_id/976.txt inflating: release/taxi_log_2008_by_id/9760.txt inflating: release/taxi_log_2008_by_id/9761.txt inflating: release/taxi_log_2008_by_id/9762.txt inflating: release/taxi_log_2008_by_id/9763.txt inflating: release/taxi_log_2008_by_id/9764.txt inflating: release/taxi_log_2008_by_id/9765.txt inflating: release/taxi_log_2008_by_id/9766.txt inflating: release/taxi_log_2008_by_id/9767.txt inflating: release/taxi_log_2008_by_id/9768.txt inflating: release/taxi_log_2008_by_id/9769.txt inflating: release/taxi_log_2008_by_id/977.txt inflating: release/taxi_log_2008_by_id/9770.txt inflating: release/taxi_log_2008_by_id/9771.txt inflating: release/taxi_log_2008_by_id/9772.txt inflating: release/taxi_log_2008_by_id/9773.txt inflating: release/taxi_log_2008_by_id/9774.txt inflating: release/taxi_log_2008_by_id/9775.txt inflating: release/taxi_log_2008_by_id/9776.txt inflating: release/taxi_log_2008_by_id/9777.txt inflating: release/taxi_log_2008_by_id/9778.txt inflating: release/taxi_log_2008_by_id/9779.txt inflating: release/taxi_log_2008_by_id/978.txt inflating: release/taxi_log_2008_by_id/9780.txt inflating: release/taxi_log_2008_by_id/9781.txt inflating: release/taxi_log_2008_by_id/9782.txt inflating: release/taxi_log_2008_by_id/9783.txt inflating: release/taxi_log_2008_by_id/9784.txt inflating: release/taxi_log_2008_by_id/9785.txt inflating: release/taxi_log_2008_by_id/9786.txt inflating: release/taxi_log_2008_by_id/9787.txt inflating: release/taxi_log_2008_by_id/9788.txt inflating: release/taxi_log_2008_by_id/9789.txt inflating: release/taxi_log_2008_by_id/979.txt inflating: release/taxi_log_2008_by_id/9790.txt inflating: release/taxi_log_2008_by_id/9791.txt inflating: release/taxi_log_2008_by_id/9792.txt inflating: release/taxi_log_2008_by_id/9793.txt inflating: release/taxi_log_2008_by_id/9794.txt inflating: release/taxi_log_2008_by_id/9795.txt inflating: release/taxi_log_2008_by_id/9796.txt inflating: release/taxi_log_2008_by_id/9797.txt inflating: release/taxi_log_2008_by_id/9798.txt inflating: release/taxi_log_2008_by_id/9799.txt inflating: release/taxi_log_2008_by_id/98.txt inflating: release/taxi_log_2008_by_id/980.txt inflating: release/taxi_log_2008_by_id/9800.txt inflating: release/taxi_log_2008_by_id/9801.txt inflating: release/taxi_log_2008_by_id/9802.txt inflating: release/taxi_log_2008_by_id/9803.txt inflating: release/taxi_log_2008_by_id/9804.txt inflating: release/taxi_log_2008_by_id/9805.txt inflating: release/taxi_log_2008_by_id/9806.txt inflating: release/taxi_log_2008_by_id/9807.txt inflating: release/taxi_log_2008_by_id/9808.txt inflating: release/taxi_log_2008_by_id/9809.txt inflating: release/taxi_log_2008_by_id/981.txt inflating: release/taxi_log_2008_by_id/9810.txt inflating: release/taxi_log_2008_by_id/9811.txt inflating: release/taxi_log_2008_by_id/9812.txt inflating: release/taxi_log_2008_by_id/9813.txt inflating: release/taxi_log_2008_by_id/9814.txt inflating: release/taxi_log_2008_by_id/9815.txt inflating: release/taxi_log_2008_by_id/9816.txt inflating: release/taxi_log_2008_by_id/9817.txt inflating: release/taxi_log_2008_by_id/9818.txt inflating: release/taxi_log_2008_by_id/9819.txt inflating: release/taxi_log_2008_by_id/982.txt inflating: release/taxi_log_2008_by_id/9820.txt inflating: release/taxi_log_2008_by_id/9821.txt inflating: release/taxi_log_2008_by_id/9822.txt inflating: release/taxi_log_2008_by_id/9823.txt inflating: release/taxi_log_2008_by_id/9824.txt inflating: release/taxi_log_2008_by_id/9825.txt inflating: release/taxi_log_2008_by_id/9826.txt inflating: release/taxi_log_2008_by_id/9827.txt inflating: release/taxi_log_2008_by_id/9828.txt inflating: release/taxi_log_2008_by_id/9829.txt inflating: release/taxi_log_2008_by_id/983.txt inflating: release/taxi_log_2008_by_id/9830.txt inflating: release/taxi_log_2008_by_id/9831.txt inflating: release/taxi_log_2008_by_id/9832.txt inflating: release/taxi_log_2008_by_id/9833.txt inflating: release/taxi_log_2008_by_id/9834.txt inflating: release/taxi_log_2008_by_id/9835.txt inflating: release/taxi_log_2008_by_id/9836.txt inflating: release/taxi_log_2008_by_id/9837.txt inflating: release/taxi_log_2008_by_id/9838.txt inflating: release/taxi_log_2008_by_id/9839.txt inflating: release/taxi_log_2008_by_id/984.txt inflating: release/taxi_log_2008_by_id/9840.txt inflating: release/taxi_log_2008_by_id/9841.txt inflating: release/taxi_log_2008_by_id/9842.txt inflating: release/taxi_log_2008_by_id/9843.txt inflating: release/taxi_log_2008_by_id/9844.txt inflating: release/taxi_log_2008_by_id/9845.txt inflating: release/taxi_log_2008_by_id/9846.txt inflating: release/taxi_log_2008_by_id/9847.txt inflating: release/taxi_log_2008_by_id/9848.txt inflating: release/taxi_log_2008_by_id/9849.txt inflating: release/taxi_log_2008_by_id/985.txt inflating: release/taxi_log_2008_by_id/9850.txt inflating: release/taxi_log_2008_by_id/9851.txt inflating: release/taxi_log_2008_by_id/9852.txt inflating: release/taxi_log_2008_by_id/9853.txt inflating: release/taxi_log_2008_by_id/9854.txt inflating: release/taxi_log_2008_by_id/9855.txt inflating: release/taxi_log_2008_by_id/9856.txt inflating: release/taxi_log_2008_by_id/9857.txt inflating: release/taxi_log_2008_by_id/9858.txt inflating: release/taxi_log_2008_by_id/9859.txt inflating: release/taxi_log_2008_by_id/986.txt inflating: release/taxi_log_2008_by_id/9860.txt inflating: release/taxi_log_2008_by_id/9861.txt inflating: release/taxi_log_2008_by_id/9862.txt inflating: release/taxi_log_2008_by_id/9863.txt inflating: release/taxi_log_2008_by_id/9864.txt inflating: release/taxi_log_2008_by_id/9865.txt inflating: release/taxi_log_2008_by_id/9866.txt inflating: release/taxi_log_2008_by_id/9867.txt inflating: release/taxi_log_2008_by_id/9868.txt inflating: release/taxi_log_2008_by_id/9869.txt inflating: release/taxi_log_2008_by_id/987.txt inflating: release/taxi_log_2008_by_id/9870.txt inflating: release/taxi_log_2008_by_id/9871.txt inflating: release/taxi_log_2008_by_id/9872.txt inflating: release/taxi_log_2008_by_id/9873.txt extracting: release/taxi_log_2008_by_id/9874.txt inflating: release/taxi_log_2008_by_id/9875.txt inflating: release/taxi_log_2008_by_id/9876.txt inflating: release/taxi_log_2008_by_id/9877.txt inflating: release/taxi_log_2008_by_id/9878.txt inflating: release/taxi_log_2008_by_id/9879.txt inflating: release/taxi_log_2008_by_id/988.txt inflating: release/taxi_log_2008_by_id/9880.txt inflating: release/taxi_log_2008_by_id/9881.txt inflating: release/taxi_log_2008_by_id/9882.txt inflating: release/taxi_log_2008_by_id/9883.txt inflating: release/taxi_log_2008_by_id/9884.txt inflating: release/taxi_log_2008_by_id/9885.txt inflating: release/taxi_log_2008_by_id/9886.txt inflating: release/taxi_log_2008_by_id/9887.txt inflating: release/taxi_log_2008_by_id/9888.txt inflating: release/taxi_log_2008_by_id/9889.txt inflating: release/taxi_log_2008_by_id/989.txt inflating: release/taxi_log_2008_by_id/9890.txt inflating: release/taxi_log_2008_by_id/9891.txt inflating: release/taxi_log_2008_by_id/9892.txt inflating: release/taxi_log_2008_by_id/9893.txt inflating: release/taxi_log_2008_by_id/9894.txt inflating: release/taxi_log_2008_by_id/9895.txt inflating: release/taxi_log_2008_by_id/9896.txt inflating: release/taxi_log_2008_by_id/9897.txt inflating: release/taxi_log_2008_by_id/9898.txt inflating: release/taxi_log_2008_by_id/9899.txt inflating: release/taxi_log_2008_by_id/99.txt inflating: release/taxi_log_2008_by_id/990.txt inflating: release/taxi_log_2008_by_id/9900.txt inflating: release/taxi_log_2008_by_id/9901.txt inflating: release/taxi_log_2008_by_id/9902.txt inflating: release/taxi_log_2008_by_id/9903.txt inflating: release/taxi_log_2008_by_id/9904.txt inflating: release/taxi_log_2008_by_id/9905.txt inflating: release/taxi_log_2008_by_id/9906.txt inflating: release/taxi_log_2008_by_id/9907.txt inflating: release/taxi_log_2008_by_id/9908.txt inflating: release/taxi_log_2008_by_id/9909.txt inflating: release/taxi_log_2008_by_id/991.txt inflating: release/taxi_log_2008_by_id/9910.txt inflating: release/taxi_log_2008_by_id/9911.txt inflating: release/taxi_log_2008_by_id/9912.txt inflating: release/taxi_log_2008_by_id/9913.txt inflating: release/taxi_log_2008_by_id/9914.txt inflating: release/taxi_log_2008_by_id/9915.txt inflating: release/taxi_log_2008_by_id/9916.txt inflating: release/taxi_log_2008_by_id/9917.txt inflating: release/taxi_log_2008_by_id/9918.txt inflating: release/taxi_log_2008_by_id/9919.txt inflating: release/taxi_log_2008_by_id/992.txt inflating: release/taxi_log_2008_by_id/9920.txt inflating: release/taxi_log_2008_by_id/9921.txt inflating: release/taxi_log_2008_by_id/9922.txt inflating: release/taxi_log_2008_by_id/9923.txt inflating: release/taxi_log_2008_by_id/9924.txt inflating: release/taxi_log_2008_by_id/9925.txt inflating: release/taxi_log_2008_by_id/9926.txt inflating: release/taxi_log_2008_by_id/9927.txt inflating: release/taxi_log_2008_by_id/9928.txt inflating: release/taxi_log_2008_by_id/9929.txt inflating: release/taxi_log_2008_by_id/993.txt inflating: release/taxi_log_2008_by_id/9930.txt inflating: release/taxi_log_2008_by_id/9931.txt inflating: release/taxi_log_2008_by_id/9932.txt inflating: release/taxi_log_2008_by_id/9933.txt inflating: release/taxi_log_2008_by_id/9934.txt inflating: release/taxi_log_2008_by_id/9935.txt inflating: release/taxi_log_2008_by_id/9936.txt inflating: release/taxi_log_2008_by_id/9937.txt inflating: release/taxi_log_2008_by_id/9938.txt inflating: release/taxi_log_2008_by_id/9939.txt inflating: release/taxi_log_2008_by_id/994.txt inflating: release/taxi_log_2008_by_id/9940.txt inflating: release/taxi_log_2008_by_id/9941.txt inflating: release/taxi_log_2008_by_id/9942.txt inflating: release/taxi_log_2008_by_id/9943.txt inflating: release/taxi_log_2008_by_id/9944.txt inflating: release/taxi_log_2008_by_id/9945.txt inflating: release/taxi_log_2008_by_id/9946.txt inflating: release/taxi_log_2008_by_id/9947.txt inflating: release/taxi_log_2008_by_id/9948.txt inflating: release/taxi_log_2008_by_id/9949.txt inflating: release/taxi_log_2008_by_id/995.txt inflating: release/taxi_log_2008_by_id/9950.txt inflating: release/taxi_log_2008_by_id/9951.txt inflating: release/taxi_log_2008_by_id/9952.txt inflating: release/taxi_log_2008_by_id/9953.txt inflating: release/taxi_log_2008_by_id/9954.txt inflating: release/taxi_log_2008_by_id/9955.txt inflating: release/taxi_log_2008_by_id/9956.txt inflating: release/taxi_log_2008_by_id/9957.txt inflating: release/taxi_log_2008_by_id/9958.txt inflating: release/taxi_log_2008_by_id/9959.txt inflating: release/taxi_log_2008_by_id/996.txt inflating: release/taxi_log_2008_by_id/9960.txt inflating: release/taxi_log_2008_by_id/9961.txt inflating: release/taxi_log_2008_by_id/9962.txt inflating: release/taxi_log_2008_by_id/9963.txt inflating: release/taxi_log_2008_by_id/9964.txt inflating: release/taxi_log_2008_by_id/9965.txt inflating: release/taxi_log_2008_by_id/9966.txt inflating: release/taxi_log_2008_by_id/9967.txt inflating: release/taxi_log_2008_by_id/9968.txt inflating: release/taxi_log_2008_by_id/9969.txt inflating: release/taxi_log_2008_by_id/997.txt inflating: release/taxi_log_2008_by_id/9970.txt inflating: release/taxi_log_2008_by_id/9971.txt inflating: release/taxi_log_2008_by_id/9972.txt inflating: release/taxi_log_2008_by_id/9973.txt inflating: release/taxi_log_2008_by_id/9974.txt inflating: release/taxi_log_2008_by_id/9975.txt inflating: release/taxi_log_2008_by_id/9976.txt inflating: release/taxi_log_2008_by_id/9977.txt inflating: release/taxi_log_2008_by_id/9978.txt inflating: release/taxi_log_2008_by_id/9979.txt inflating: release/taxi_log_2008_by_id/998.txt inflating: release/taxi_log_2008_by_id/9980.txt inflating: release/taxi_log_2008_by_id/9981.txt inflating: release/taxi_log_2008_by_id/9982.txt inflating: release/taxi_log_2008_by_id/9983.txt inflating: release/taxi_log_2008_by_id/9984.txt inflating: release/taxi_log_2008_by_id/9985.txt inflating: release/taxi_log_2008_by_id/9986.txt inflating: release/taxi_log_2008_by_id/9987.txt inflating: release/taxi_log_2008_by_id/9988.txt inflating: release/taxi_log_2008_by_id/9989.txt inflating: release/taxi_log_2008_by_id/999.txt inflating: release/taxi_log_2008_by_id/9990.txt inflating: release/taxi_log_2008_by_id/9991.txt inflating: release/taxi_log_2008_by_id/9992.txt inflating: release/taxi_log_2008_by_id/9993.txt inflating: release/taxi_log_2008_by_id/9994.txt inflating: release/taxi_log_2008_by_id/9995.txt inflating: release/taxi_log_2008_by_id/9996.txt inflating: release/taxi_log_2008_by_id/9997.txt inflating: release/taxi_log_2008_by_id/9998.txt inflating: release/taxi_log_2008_by_id/9999.txt inflating: release/Thumbs.db inflating: release/user_guide.pdf gzip: all.txt.gz already exists; not overwritten
%sh

# This command will copy over each file to dbfs without any form of processing. It will take a long time and
# also surpass the limits of the free community edition.

unzip -o T-driveTaxiTrajectories.zip -d /dbfs/files/trajectories
Archive: T-driveTaxiTrajectories.zip inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/100.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1000.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10000.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10001.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10002.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10003.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10004.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10005.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10006.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10007.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10008.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10009.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1001.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10010.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10011.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10012.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10013.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10014.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10015.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10016.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10017.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10018.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10019.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1002.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10020.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10021.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10022.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10023.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10024.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10025.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10026.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10027.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10028.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10029.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1003.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10030.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10031.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10032.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10033.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10034.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10035.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10036.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10037.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10038.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10039.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1004.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10040.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10041.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10042.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10043.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10044.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10045.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10046.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10047.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10048.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10049.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1005.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10050.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10051.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10052.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10053.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10054.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10055.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10056.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10057.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10058.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10059.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1006.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10060.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10061.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10062.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10063.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10064.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10065.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10066.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10067.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10068.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10069.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1007.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10070.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10071.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10072.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10073.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10074.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10075.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10076.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10077.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10078.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10079.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1008.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10080.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10081.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10082.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10083.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10084.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10085.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10086.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10087.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10088.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10089.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1009.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10090.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10091.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10092.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10093.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10094.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10095.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10096.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10097.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10098.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10099.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/101.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1010.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10100.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10101.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10102.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10103.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10104.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10105.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10106.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10107.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10108.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10109.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1011.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10110.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10111.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10112.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10113.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10114.txt extracting: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10115.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10116.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10117.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10118.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10119.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1012.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10120.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10121.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10122.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10123.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10124.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10125.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10126.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10127.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10128.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10129.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1013.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10130.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10131.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10132.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10133.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10134.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10135.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10136.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10137.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10138.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10139.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1014.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10140.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10141.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10142.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10143.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10144.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10145.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10146.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10147.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10148.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10149.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1015.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10150.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10151.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10152.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10153.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10154.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10155.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10156.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10157.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10158.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10159.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1016.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10160.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10161.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10162.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10163.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10164.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10165.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10166.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10167.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10168.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10169.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1017.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10170.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10171.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10172.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10173.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10174.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10175.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10176.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10177.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10178.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10179.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1018.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10180.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10181.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10182.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10183.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10184.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10185.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10186.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10187.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10188.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10189.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1019.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10190.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10191.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10192.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10193.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10194.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10195.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10196.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10197.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10198.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10199.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/102.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1020.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10200.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10201.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10202.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10203.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10204.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10205.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10206.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10207.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10208.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10209.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1021.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10210.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10211.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10212.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10213.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10214.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10215.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10216.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10217.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10218.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10219.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1022.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10220.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10221.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10222.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10223.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10224.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10225.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10226.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10227.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10228.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10229.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1023.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10230.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10231.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10232.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10233.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10234.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10235.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10236.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10237.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10238.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10239.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1024.txt extracting: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10240.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10241.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10242.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10243.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10244.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10245.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10246.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10247.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10248.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10249.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1025.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10250.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10251.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10252.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10253.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10254.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10255.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10256.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10257.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10258.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10259.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1026.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10260.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10261.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10262.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10263.txt extracting: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10264.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10265.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10266.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10267.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10268.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10269.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1027.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10270.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10271.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10272.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10273.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10274.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10275.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10276.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10277.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10278.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10279.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/1028.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10280.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10281.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10282.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10283.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10284.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10285.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/10286.txt *** WARNING: skipped 746944 bytes of output *** inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9708.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9709.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/971.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9710.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9711.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9712.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9713.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9714.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9715.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9716.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9717.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9718.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9719.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/972.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9720.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9721.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9722.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9723.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9724.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9725.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9726.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9727.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9728.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9729.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/973.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9730.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9731.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9732.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9733.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9734.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9735.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9736.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9737.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9738.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9739.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/974.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9740.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9741.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9742.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9743.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9744.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9745.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9746.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9747.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9748.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9749.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/975.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9750.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9751.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9752.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9753.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9754.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9755.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9756.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9757.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9758.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9759.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/976.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9760.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9761.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9762.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9763.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9764.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9765.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9766.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9767.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9768.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9769.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/977.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9770.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9771.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9772.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9773.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9774.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9775.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9776.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9777.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9778.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9779.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/978.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9780.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9781.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9782.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9783.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9784.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9785.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9786.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9787.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9788.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9789.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/979.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9790.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9791.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9792.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9793.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9794.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9795.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9796.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9797.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9798.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9799.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/98.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/980.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9800.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9801.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9802.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9803.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9804.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9805.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9806.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9807.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9808.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9809.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/981.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9810.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9811.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9812.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9813.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9814.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9815.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9816.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9817.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9818.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9819.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/982.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9820.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9821.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9822.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9823.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9824.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9825.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9826.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9827.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9828.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9829.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/983.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9830.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9831.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9832.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9833.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9834.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9835.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9836.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9837.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9838.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9839.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/984.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9840.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9841.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9842.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9843.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9844.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9845.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9846.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9847.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9848.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9849.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/985.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9850.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9851.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9852.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9853.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9854.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9855.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9856.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9857.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9858.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9859.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/986.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9860.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9861.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9862.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9863.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9864.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9865.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9866.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9867.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9868.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9869.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/987.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9870.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9871.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9872.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9873.txt extracting: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9874.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9875.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9876.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9877.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9878.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9879.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/988.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9880.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9881.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9882.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9883.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9884.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9885.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9886.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9887.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9888.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9889.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/989.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9890.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9891.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9892.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9893.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9894.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9895.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9896.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9897.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9898.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9899.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/99.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/990.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9900.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9901.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9902.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9903.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9904.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9905.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9906.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9907.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9908.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9909.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/991.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9910.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9911.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9912.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9913.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9914.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9915.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9916.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9917.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9918.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9919.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/992.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9920.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9921.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9922.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9923.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9924.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9925.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9926.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9927.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9928.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9929.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/993.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9930.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9931.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9932.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9933.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9934.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9935.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9936.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9937.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9938.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9939.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/994.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9940.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9941.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9942.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9943.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9944.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9945.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9946.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9947.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9948.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9949.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/995.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9950.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9951.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9952.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9953.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9954.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9955.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9956.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9957.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9958.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9959.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/996.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9960.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9961.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9962.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9963.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9964.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9965.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9966.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9967.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9968.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9969.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/997.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9970.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9971.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9972.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9973.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9974.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9975.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9976.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9977.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9978.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9979.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/998.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9980.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9981.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9982.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9983.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9984.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9985.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9986.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9987.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9988.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9989.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/999.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9990.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9991.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9992.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9993.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9994.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9995.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9996.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9997.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9998.txt inflating: /dbfs/files/trajectories/release/taxi_log_2008_by_id/9999.txt inflating: /dbfs/files/trajectories/release/Thumbs.db inflating: /dbfs/files/trajectories/release/user_guide.pdf
%fs ls "dbfs:/files/trajectories/release/taxi_log_2008_by_id"
Command skipped
// Load files into an RDD
val fileContentsRDD = sc.textFile("dbfs:/files/trajectories/all.txt.gz")
val linesRDD = fileContentsRDD.flatMap(l => l.split("\n"))
fileContentsRDD: org.apache.spark.rdd.RDD[String] = dbfs:/files/trajectories/all.txt.gz MapPartitionsRDD[373] at textFile at command-1112260032678445:2 linesRDD: org.apache.spark.rdd.RDD[String] = MapPartitionsRDD[374] at flatMap at command-1112260032678445:3
display(linesRDD.toDF)
10000,2008-02-02 13:39:48,116.35924,39.93669
10000,2008-02-02 13:44:50,116.35929,39.93688
10000,2008-02-02 13:49:52,116.35926,39.93681
10000,2008-02-02 13:54:54,116.35928,39.93646
10000,2008-02-02 13:54:54,116.35928,39.93646
10000,2008-02-02 13:59:56,116.35926,39.93664
10000,2008-02-02 14:04:58,116.35933,39.93683
10000,2008-02-02 14:10:00,116.35925,39.93661
10000,2008-02-02 14:15:02,116.35927,39.93672
10000,2008-02-02 14:20:04,116.35923,39.93663
10000,2008-02-02 14:25:06,116.35918,39.93654
10000,2008-02-02 14:30:08,116.35923,39.93657
10000,2008-02-02 14:35:10,116.35913,39.93646
10000,2008-02-02 14:40:12,116.35914,39.93646
10000,2008-02-02 14:45:14,116.35924,39.93657
10000,2008-02-02 14:50:16,116.35883,39.93676
10000,2008-02-02 14:55:18,116.39469,39.94764
10000,2008-02-02 15:10:24,116.57093,40.0385
10000,2008-02-02 15:15:26,116.58611,40.07727
10000,2008-02-02 15:50:39,116.57919,40.04747
10000,2008-02-02 16:00:43,116.466,39.97265
10000,2008-02-02 16:05:45,116.45546,39.9426
10000,2008-02-02 16:10:47,116.45523,39.93272
10000,2008-02-02 16:15:49,116.4543,39.93239
10000,2008-02-02 16:20:51,116.44984,39.94003
10000,2008-02-02 16:25:53,116.43311,39.93987
10000,2008-02-02 16:30:55,116.4278,39.94268
10000,2008-02-02 16:35:57,116.42347,39.94846
10000,2008-02-02 16:40:59,116.3929,39.94768
10000,2008-02-02 16:46:01,116.37333,39.94754
10000,2008-02-02 16:51:03,116.35789,39.94485
10000,2008-02-02 16:56:05,116.34083,39.93792
10000,2008-02-02 17:01:07,116.29488,39.94436
10000,2008-02-02 17:06:08,116.2836,39.93108
10000,2008-02-02 17:11:11,116.27844,39.93098
10000,2008-02-02 17:16:12,116.28677,39.92274
10000,2008-02-02 17:21:14,116.30417,39.93008
10000,2008-02-02 17:26:16,116.3038,39.92401
10000,2008-02-02 17:31:18,116.291,39.91679
10000,2008-02-02 17:36:20,116.29601,39.90801
10000,2008-02-02 17:41:22,116.28916,39.9065
10000,2008-02-02 17:51:26,116.29788,39.9431
10000,2008-02-02 17:56:28,116.31001,39.95028
10000,2008-02-02 18:01:30,116.30761,39.95005
10000,2008-02-02 18:01:30,116.30761,39.95005
10000,2008-02-02 18:06:32,116.30766,39.94994
10000,2008-02-02 18:11:34,116.30768,39.94995
10000,2008-02-02 18:16:36,116.30767,39.94995
10000,2008-02-02 18:21:38,116.30765,39.94997
10000,2008-02-02 18:26:40,116.30765,39.94994
10000,2008-02-02 18:31:42,116.31787,39.94911
10000,2008-02-02 18:36:44,116.30842,39.93938
10000,2008-02-02 18:46:48,116.27669,39.94533
10000,2008-02-02 18:51:50,116.27232,39.94546
10000,2008-02-02 18:56:52,116.26794,39.94184
10000,2008-02-02 19:01:54,116.26896,39.91997
10000,2008-02-02 19:06:56,116.26797,39.8856
10000,2008-02-02 19:11:58,116.27653,39.85633
10000,2008-02-02 19:17:00,116.27687,39.84575
10000,2008-02-02 19:22:02,116.27729,39.85817
10000,2008-02-02 19:32:06,116.2682,39.88983
10000,2008-02-02 19:37:08,116.26832,39.90234
10000,2008-02-02 19:42:10,116.27676,39.90615
10000,2008-02-02 19:52:14,116.30611,39.90656
10000,2008-02-02 19:57:16,116.30056,39.92293
10000,2008-02-02 20:02:18,116.282,39.92306
10000,2008-02-02 20:02:18,116.282,39.92306
10000,2008-02-02 20:02:18,116.282,39.92306
10000,2008-02-02 20:02:18,116.282,39.92306
10000,2008-02-02 20:07:20,116.26068,39.92326
10000,2008-02-02 20:12:22,116.24605,39.92509
10000,2008-02-02 20:17:24,116.2327,39.92837
10000,2008-02-02 20:22:26,116.25229,39.92811
10000,2008-02-02 20:27:27,116.25859,39.92338
10000,2008-02-02 20:32:29,116.2879,39.92277
10000,2008-02-02 20:37:31,116.31716,39.92227
10000,2008-02-02 20:42:33,116.32555,39.92183
10000,2008-02-02 20:47:35,116.34593,39.92212
10000,2008-02-02 20:52:37,116.35401,39.91266
10000,2008-02-02 20:57:39,116.35709,39.90907
10000,2008-02-02 21:02:41,116.35698,39.90082
10000,2008-02-02 21:07:43,116.35713,39.89946
10000,2008-02-02 21:12:45,116.35713,39.89784
10000,2008-02-02 21:17:47,116.35723,39.89009
10000,2008-02-02 21:22:49,116.35731,39.88515
10000,2008-02-02 21:27:51,116.36459,39.87708
10000,2008-02-02 21:32:53,116.36119,39.88414
10000,2008-02-02 21:37:55,116.35192,39.88817
10000,2008-02-02 21:42:57,116.32201,39.89594
10000,2008-02-02 21:47:59,116.31515,39.90317
10000,2008-02-02 21:53:01,116.32928,39.90874
10000,2008-02-02 21:58:03,116.34247,39.91261
10000,2008-02-02 22:03:05,116.35,39.91254
10000,2008-02-02 22:03:05,116.35,39.91254
10000,2008-02-02 22:08:07,116.34767,39.92238
10000,2008-02-02 22:13:09,116.34645,39.92682
10000,2008-02-02 22:23:56,116.35943,39.93673
10000,2008-02-02 22:34:00,116.35943,39.93675
10000,2008-02-02 22:44:04,116.35943,39.93675
10000,2008-02-02 23:14:16,116.35944,39.93673

Showing the first 1000 rows.

Now that the data is in DBFS, lets turn it into a dataframe.

import magellan.{Point, Polygon, PolyLine}

import org.apache.spark.sql.magellan.dsl.expressions._
import org.apache.spark.sql.Row
import org.apache.spark.sql.types._
import org.apache.spark.sql.functions._

import java.sql.Timestamp
import magellan.{Point, Polygon, PolyLine} import org.apache.spark.sql.magellan.dsl.expressions._ import org.apache.spark.sql.Row import org.apache.spark.sql.types._ import org.apache.spark.sql.functions._ import java.sql.Timestamp

Now we define the schema for our the rows in our taxi data frame. This follows directly from the Raam Sriharsha's Uber Example

case class taxiRecord(
  taxiId: Int,
  time: String,
  point: Point
  )
defined class taxiRecord

Use Java date/time utilities to parse the date strings in the zip files.

import java.text.SimpleDateFormat 
val dateFormat = new SimpleDateFormat("yyyy-MM-dd HH:mm:ss")
import java.text.SimpleDateFormat dateFormat: java.text.SimpleDateFormat = java.text.SimpleDateFormat@4f76f1a0

Now parse the data line by line, splitting by commas and casting to the correct datatypes. Wrapping in a try-catch block will avoid crashes when invalid data is encountered. Currently this invalid entries are discarded, but may be of interest to see if some data can be recovered. For further information on data cleaning of location data in chapter 8 of Advanced Analytics with Spark

val taxiData = linesRDD.map{line =>
  try {
    val parts = line.split(",")
    val id = parts(0).toInt
    val time = parts(1)
    
    val point = Point(parts(2).toDouble, 
                      parts(3).toDouble)
    
    taxiRecord(id, time, point)
    
  } catch {
    // Label invalid datapoints
      case e: Throwable => {
        val p = Point(-1.0, -1.0)
        val id = -1
        val time = "0000-00-00 00:00:00"
        taxiRecord( id, time, p)
      }
  }
}
.toDF
.select($"taxiId", to_utc_timestamp($"time", "yyyy-MM-dd HH:mm:ss").as("timeStamp"), $"point") // warning unixTime
.repartition(100)
.where($"taxiId" > -1)
.cache()
taxiData: org.apache.spark.sql.Dataset[org.apache.spark.sql.Row] = [taxiId: int, timeStamp: timestamp ... 1 more field]
taxiData.show
+------+-------------------+--------------------+ |taxiId| timeStamp| point| +------+-------------------+--------------------+ | 2454|2008-02-04 22:01:01|Point(116.58287, ...| | 2925|2008-02-08 16:28:30|Point(116.60126, ...| | 6974|2008-02-04 07:42:03|Point(116.43697, ...| | 8662|2008-02-05 12:38:33|Point(116.37491, ...| | 5488|2008-02-04 13:59:00|Point(116.33306, ...| | 3583|2008-02-06 20:13:26|Point(116.34007, ...| | 3242|2008-02-04 02:45:23|Point(116.45911, ...| | 2205|2008-02-02 17:53:47|Point(116.40252, ...| | 6556|2008-02-03 12:27:20|Point(116.58243, ...| | 3878|2008-02-04 04:56:57|Point(116.49717, ...| | 6656|2008-02-03 07:08:18|Point(116.64105, ...| | 7215|2008-02-02 20:52:50|Point(116.49212, ...| | 8345|2008-02-04 23:07:37|Point(116.33331, ...| | 3579|2008-02-03 23:41:04|Point(116.31527, ...| | 1436|2008-02-05 22:37:21|Point(116.45273, ...| | 7284|2008-02-06 07:10:18|Point(117.11203, ...| | 3546|2008-02-07 15:38:17|Point(116.02403, ...| | 950|2008-02-04 07:48:11|Point(116.25267, ...| | 5555|2008-02-05 21:34:01|Point(116.30294, ...| | 4798|2008-02-07 01:06:30|Point(116.3439, 4...| +------+-------------------+--------------------+ only showing top 20 rows
taxiData.count
res3: Long = 70651936

To use this data in new versions of spark not supported by Magellan (yet!), the dataframe containing the trips can be saved to a parquet file and accessed in other notebooks.

Note: The datatypes defined by Magellan cannot be stored in a parquet file. To work around this simply store the raw latitude and longitude values instead of the Magellan objects themselves.

taxiData
// Helper function to extract latitude and longitued
val pointToTuple = udf( (point: Point) => Array(point.getX(), point.getY()))

val taxiDataNoMagellan = taxiData.select($"taxiId", $"timeStamp", pointToTuple($"point").as("latlon")).drop("point")

taxiDataNoMagellan.write.mode("overwrite").parquet("dbfs:/datasets/t-drive-trips")
pointToTuple: org.apache.spark.sql.expressions.UserDefinedFunction = UserDefinedFunction(<function1>,ArrayType(DoubleType,false),Some(List(org.apache.spark.sql.types.PointUDT@45b39dda))) taxiDataNoMagellan: org.apache.spark.sql.DataFrame = [taxiId: int, timeStamp: timestamp ... 1 more field]
taxiData.write.mode("overwrite").parquet("dbfs:/datasets/t-drive-trips-magellan") // magellan
spark.read.parquet("dbfs:/datasets/t-drive-trips-magellan").count()
res23: Long = 70651936

Let's do some diagnostic tuning

%run scalable-data-science/sds-2-x-tuning/00_dbcTuningUtilities2run 
printRecordsPerPartition: (df: org.apache.spark.sql.Dataset[org.apache.spark.sql.Row])Unit computeFileStats: (path: String)(Long, Long) cacheAs: (df: org.apache.spark.sql.DataFrame, name: String, level: org.apache.spark.storage.StorageLevel)org.apache.spark.sql.DataFrame benchmarkCount: (func: () => org.apache.spark.sql.DataFrame)(org.apache.spark.sql.DataFrame, Long, Long) defined class JobResults defined class Node defined class Tracker tracker: Tracker = Tracker@33a7b056
printRecordsPerPartition(taxiData)
Per-Partition Counts: * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706519 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706520 * 706519 * 706519 * 706519
taxiData.count()
res10: Long = 70651936
taxiData.rdd.getNumPartitions
res9: Int = 100