DEV Community

Discussion on: S3 vs HDFS

Collapse
neverchanje profile image
Wu Tao

Basically right. But using S3 means you probably have to use ec2 & other AWS products as well. I think that is why HDFS still has its market.

Collapse
luminousmen profile image
luminousmen Author

Not really - you can use whatever platform you want with s3. I think HDFS nowadays is used internally by those cloud providers or on-prem solutions.

Collapse
neverchanje profile image
Wu Tao

Sure, but if you run large dataset computation on top of aws s3 without deploying on ec2, it will probably cost a big I/O bandwidth payroll.