The latest articles on DEV Community by Pawan Kumar (@connecttopawan). https://dev.to/connecttopawan https://media2.dev.to/dynamic/image/width=90,height=90,fit=cover,gravity=auto,format=auto/https:%2F%2Fdev-to-uploads.s3.amazonaws.com%2Fuploads%2Fuser%2Fprofile_image%2F662371%2Fe3da4950-5781-42ae-bb97-1d3bd0ad1230.jpeg https://dev.to/connecttopawan en Pawan Kumar Tue, 06 Jul 2021 09:40:41 +0000 https://dev.to/connecttopawan/spark-replace-collect-d6e https://dev.to/connecttopawan/spark-replace-collect-d6e <p>I am having code as:<br> </p> <div class="highlight js-code-highlight"> <pre class="highlight plaintext"><code>new_df=spark.sql("Select col1,col2 from table1 where id=2").collect()[0][0] </code></pre> </div> <p>I have tried toLocalIterator() but getting message that is not subscriptable.<br> Please suggest a better way to replace collect()[0][0].</p> spark