How to specify colClasses when reading a very big csv file into R using read.table.ffdf? -


I use the read.table.ffdf function, trying to read a very large CCV file around the size of 20g I was having trouble in specifying the colClasses option in "FF" package, but read.csv ().

I have to specify the callclass option because some column labels are very long integers in the file, such as with 11 digits, for example, the file has two rows 

  86246, 205,17,171 9,104116343,8435,2013-03-13,12, oz, 1,2,5 9 86246,205,17, 1719,10800749282,8435,2013-03-13,12, oz, 1,2.5 9 < / Code>  
 Integer 10800749282 is too large for the "integer" type, and it is not only "numerical" or "character" but above the 104116343 value in the row above is not enough, so r is the default From this column will treat this column as "integer"  
 I tried the following but found an error. Does anyone know the solution to this problem? Highly appreciated!  
  dat < - read.table.ffdf (file = "file.csv", FUN = "read.csv", na.strings = "", colClasses = "character" error in FIF "(initdata = initdata, length = length, level = Level, ordered = command given: vmode 'character' is not implemented    
 
 
 Your error indicates that there is no 'character' data type implemented within the FF environment. All characters should be treated  x  while accepting your file as  factors  Strong> Number of columns, working below Is:  
  dat  not  to import all the data as factors, because it is very inefficient. Just click on all your numerical data Import as a 'numeric.' Assume your first  5  column and the remaining  3  characters are:  
  dat < - read.csv.ffdf (NULL, file = "file.csv", na.strings = "", colClasses = c (representative ("numeric", 5), representative ("factor", 3)))

Comments

Post a Comment

Popular posts from this blog

c - Mpirun hangs when mpi send and recieve is put in a loop -

I was trying to use the program to use mifrewan on 4 node clusters. Distributing node 0 data in nodes 1, 2 and 3. In the program, from '90 'to variable values ​​of' dior 'to be calculated. Therefore the node is distributing data and collecting results in an omitted fashion (for different values ​​of var 'dir') when do {*******} Whereas (dir Loop is given, Mippun is hanging, and no output is found. But when I comment on two {*******} (dir The loop output is obtained for the initial value of variable dir dir = -90 ), and that output is correct. The problem occurs when the loop is given. Can anyone help me in solving this problem. #include "mpi.h" int main (int argc, char * argv []) Float dir = -90; Int rank, nanoprakash; MPI_Status status; MPI_Init (& amp; argc, & argv); MPI_Comm_rank (MPI_COMM_WORLD, & amp; Rank); MPI_Comm_size (MPI_COMM_WORLD, & amp; numprocs); If (rank == 0) {/ / data to begin / / (dest = 1; dest ...
Read more

python - Apply coupon to a customer's subscription based on non-stripe related actions on the site -

I can not find anything in the source about using coupons after subscribing to a user's plan. Is it possible to use a coupon to credit a user's membership after initial subscription? If not, what is the best option? Specifically, I want to give a user 100% coupon for that month, when they take 5 [site specific actions]. This is possible, but may not be the best idea. Coupons are currently applied to the stripe, then apply again at the customer level and each client can have a single coupon. So if you are already offering discounts to the coupon, then the customer who is currently in the present will also give up. It also means that if you are using a recently-added multiple subscription capacity, then all of the user's subscription will be ready for the month. Coupons can be set to "Once", only once (as the only name) can be used by any customer, so if this credit can earn more than once, You will have to maintain a 100% discount coupon continuousl...
Read more

java - Unable to get JDBC connection in Spring application to MySQL -

मैंने स्प्रिंग में डीबी कॉन्फ़िगरेशन का पालन किया है: & lt; bean id = "dataSource" Class = "org.apache.commons.dbcp.BasicDataSource" नष्ट-विधि = "बंद" & gt; & Lt; प्रॉपर्टी नाम = "url" मान = "jdbc: dburl" / & gt; & Lt; संपत्ति नाम = "driverClassName" मान = "com.mysql.jdbc.Driver" / & gt; & Lt; संपत्ति नाम = "उपयोगकर्ता नाम" मान = "उपयोगकर्ता नाम" / & gt; & Lt; संपत्ति नाम = "पासवर्ड" मान = "पासवॉर्फ" / & gt; & Lt; प्रॉपर्टी नाम = "हटाए गए हटाए गए" मान = "सही" / & gt; & Lt; गुण नाम = "प्रारंभिक आकार" मान = "3" / & gt; & Lt; संपत्ति नाम = "अधिकतमअक्टिव" मान = "5" / & gt; & Lt; / सेम ​​& gt; डीबी से गुण मूल्यों को लोड करने के लिए अतिरिक्त कॉन्फ़िगरेशन। & lt; bean id = "config1" class = "org.apache.commons.configuration....
Read more