Databricks Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 DUMPS WITH REAL EXAM QUESTIONS
PDF
Last Updated : Jun 04, 2026
180 Total Questions
$453 Months Free Updates
PDF + Test Engine
$653 Months Free Updates
Test Engine
Last Updated : Jun 04, 2026
180 Total Questions
$553 Months Free Updates
Money Back Guarantee WithDatabricks Certified Associate Developer for Apache Spark 3.0 Exam Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 Dumps
We are providing free Databricks Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 practice questions answers that show the quality of our Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 exam dumps. We ensure you that Exam4Lead is one of the most reliable website for Databricks Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 exam preparation. Feel free and download our Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 dumps and pass your exam with full confidence.
Very Effective & Helpful Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 Dumps PDF + Test Engine
If you are worried about your Databricks Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 exam and you don't prepare it yet and you also still searching worthy study material for your Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 exam preparation. Then don't worry about it anymore we have one solution for your exam problems. Exam4Lead team is working for many years in this field and we have thousands of satisfied customers from entire world. We will provide you exactly same Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 real exam questions with valid answers in PDF file which helps you to prepare it easily and you will ready to do your exam and pass it in first attempt. If you want to check your exam preparation then we have Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 online practice software as well. You can check your Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 exam preparation online with our test engine.
Increase Your Confidence & Boost your Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 Exam Preparation
Increase your Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 exam preparation by using our test engine. It helps to check your exam preparation and it create real exam environment. We designed it like you are taking real exam, it has two phase first is practice mode and second is real exam mode. In practice mode you will practice all the Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 exam questions with answer and in exam mode you will check your exam preparation and you will sense that you are taking actual exam which boost your confidence for taking your exam.
Exam4Lead.com is providing 100% authentic Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 exam dumps that are verified by IT experts. By using our Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 study material you will easily clear your certification in first attempt and you can easily score more than 95%. We will give you 100% passing guarantee on your purchased exam dumps and also money back assurance if you will not clear your exam. Our Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 dumps PDF file has entirely unique questions and answers that are valid all over the world and you’ll get these questions in your real exam. Exam4lead is user friendly and easily accessible on mobile devices. Our exam database is regularly updated all over the year to contain the new practice questions & answers for the Databricks Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 exam. Our success rate from past 5 year’s very inspiring. Our customers are able to build their future in IT field.
24/7 CUSTOMER SUPPORT
We offer you a free live customer support for a smooth and stress free Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 preparation. For any question regarding the Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 dumps feel free to write us anytime.
MONEY BACK GUARANTEE
Exam4Lead offers a 100% refund in case of failure in Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 exam despite preparing with its products.Thus, you are not losing anything here and your investment is also secure.
FREE PRODUCT UPDATES
When you will buy Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 preparation material from Exam4Lead you will get the latest one. Exam4Lead also offers the free Databricks-Certified-Associate-Developer-for-Apache-Spark-3.0 updates within 90 days of your purchase.
Which of the following code blocks immediately removes the previously cached DataFrame
transactionsDf from memory and disk?
A. array_remove(transactionsDf, "*") B. transactionsDf.unpersist() (Correct) C. del transactionsDf D. transactionsDf.clearCache() E. transactionsDf.persist()
Answer: B Explanation: transactionsDf.unpersist() Correct. The DataFrame.unpersist() command does exactly what the asks for - it removes all cached parts of the DataFrame from memory and disk. del transactionsDf False. While this option can help remove the DataFrame from memory and disk, it does not do so immediately. The reason is that this command just notifies the Python garbage collector that the transactionsDf now may be deleted from memory. However, the garbage collector does not do so immediately and, if you wanted it to run immediately, would need to be specifically triggered to do so. Find more information linked below. array_remove(transactionsDf, "*") Incorrect. The array_remove method from pyspark.sql.functions is used for removing elements from arrays in columns that match a specific condition. Also, the first argument would be a column, and not a DataFrame as shown in the code block. transactionsDf.persist() No. This code block does exactly the opposite of what is asked for: It caches (writes) DataFrame transactionsDf to memory and disk. Note that even though you do not pass in a specific storage level here, Spark will use the default storage level (MEMORY_AND_DISK). transactionsDf.clearCache() Wrong. Spark's DataFrame does not have a clearCache() method. More info: pyspark.sql.DataFrame.unpersist ” PySpark 3.1.2 documentation, python - How to delete an RDD in PySpark for the purpose of releasing resources? - Stack Overflow Static notebook | Dynamic notebook: See test 3, (Databricks import instructions)
Question # 2
The code block shown below should return a new 2-column DataFrame that shows one attribute
from column attributes per row next to the associated itemName, for all suppliers in column supplier
whose name includes Sports. Choose the answer that correctly fills the blanks in the code block to
accomplish this.
Sample of DataFrame itemsDf:
1. +------+----------------------------------+-----------------------------+-------------------+
2. |itemId|itemName |attributes |supplier |
3. +------+----------------------------------+-----------------------------+-------------------+
4. |1 |Thick Coat for Walking in the Snow|[blue, winter, cozy] |Sports Company Inc.|
5. |2 |Elegant Outdoors Summer Dress |[red, summer, fresh, cooling]|YetiX |
6. |3 |Outdoors Backpack |[green, summer, travel] |Sports Company Inc.|
7. +------+----------------------------------+-----------------------------+-------------------+
Code block:
itemsDf.__1__(__2__).select(__3__, __4__)
A. 1. filter 2. col("supplier").isin("Sports") 3. "itemName" 4. explode(col("attributes")) B. 1. where 2. col("supplier").contains("Sports") 3. "itemName" 4. "attributes" C. 1. where 2. col(supplier).contains("Sports") 3. explode(attributes) 4. itemName D. 1. where 2. "Sports".isin(col("Supplier")) 3. "itemName" 4. array_explode("attributes") E. 1. filter 2. col("supplier").contains("Sports") 3. "itemName" 4. explode("attributes")
Answer: E Explanation: Output of correct code block: +----------------------------------+------+ |itemName |col | +----------------------------------+------+ |Thick Coat for Walking in the Snow|blue | |Thick Coat for Walking in the Snow|winter| |Thick Coat for Walking in the Snow|cozy | |Outdoors Backpack |green | |Outdoors Backpack |summer| |Outdoors Backpack |travel| +----------------------------------+------+ The key to solving this is knowing about Spark's explode operator. Using this operator, you can extract values from arrays into single rows. The following guidance steps through the answers systematically from the first to the last gap. Note that there are many ways to solving the gap questions and filtering out wrong answers, you do not always have to start filtering out from the first gap, but can also exclude some answers based on obvious problems you see with them. The answers to the first gap present you with two options: filter and where. These two are actually synonyms in PySpark, so using either of those is fine. The answer options to this gap therefore do not help us in selecting the right answer. The second gap is more interesting. One answer option includes "Sports".isin(col("Supplier")). This construct does not work, since Python's string does not have an isin method. Another option contains col(supplier). Here, Python will try to interpret supplier as a variable. We have not set this variable, so this is not a viable answer. Then, you are left with answers options that include col ("supplier").contains("Sports") and col("supplier").isin("Sports"). The states that we are looking for suppliers whose name includes Sports, so we have to go for the contains operator here. We would use the isin operator if we wanted to filter out for supplier names that match any entries in a list of supplier names. Finally, we are left with two answers that fill the third gap both with "itemName" and the fourth gap either with explode("attributes") or "attributes". While both are correct Spark syntax, only explode ("attributes") will help us achieve our goal. Specifically, the asks for one attribute from column attributes per row - this is what the explode() operator does. One answer option also includes array_explode() which is not a valid operator in PySpark. More info: pyspark.sql.functions.explode ” PySpark 3.1.2 documentation Static notebook | Dynamic notebook: See test 3, (Databricks import instructions)
Question # 3
The code block shown below should add a column itemNameBetweenSeparators to DataFrame
itemsDf. The column should contain arrays of maximum 4 strings. The arrays should be composed of
the values in column itemsDf which are separated at - or whitespace characters. Choose the answer
that correctly fills the blanks in the code block to accomplish this.
Sample of DataFrame itemsDf:
1. +------+----------------------------------+-------------------+
2. |itemId|itemName |supplier |
3. +------+----------------------------------+-------------------+
4. |1 |Thick Coat for Walking in the Snow|Sports Company Inc.|
5. |2 |Elegant Outdoors Summer Dress |YetiX |
6. |3 |Outdoors Backpack |Sports Company Inc.|
7. +------+----------------------------------+-------------------+
Code block:
itemsDf.__1__(__2__, __3__(__4__, "[\s\-]", __5__))
Answer: A Explanation: This deals with the parameters of Spark's split operator for strings. To solve this question, you first need to understand the difference between DataFrame.withColumn() and DataFrame.withColumnRenamed(). The correct option here is DataFrame.withColumn() since, according to the question, we want to add a column and not rename an existing column. This leaves you with only 3 answers to consider. The second gap should be filled with the name of the new column to be added to the DataFrame. One of the remaining answers states the column name as itemNameBetweenSeparators, while the other two state it as "itemNameBetweenSeparators". The correct option here is "itemNameBetweenSeparators", since the other option would let Python try to interpret itemNameBetweenSeparators as the name of a variable, which we have not defined. This leaves you with 2 answers to consider. The decision boils down to how to fill gap 5. Either with 4 or with 5. The asks for arrays of maximum four strings. The code in gap 5 relates to the limit parameter of Spark's split operator (see documentation linked below). The documentation states that "the resulting array's length will not be more than limit", meaning that we should pick the answer option with 4 as the code in the fifth gap here. On a side note: One answer option includes a function str_split. This function does not exist in pySpark. More info: pyspark.sql.functions.split ” PySpark 3.1.2 documentation Static notebook | Dynamic notebook: See test 3, (Databricks import instructions)
Question # 4
Which of the following code blocks reads in the two-partition parquet file stored at filePath, making
sure all columns are included exactly once even though each partition has a different schema?
Schema of first partition:
1. root
2. |-- transactionId: integer (nullable = true)
3. |-- predError: integer (nullable = true)
4. |-- value: integer (nullable = true)
5. |-- storeId: integer (nullable = true)
6. |-- productId: integer (nullable = true)
7. |-- f: integer (nullable = true)
Schema of second partition:
1. root
2. |-- transactionId: integer (nullable = true)
3. |-- predError: integer (nullable = true)
4. |-- value: integer (nullable = true)
5. |-- storeId: integer (nullable = true)
6. |-- rollId: integer (nullable = true)
7. |-- f: integer (nullable = true)
8. |-- tax_id: integer (nullable = false)
A. spark.read.parquet(filePath, mergeSchema='y') B. spark.read.option("mergeSchema", "true").parquet(filePath) C. spark.read.parquet(filePath) D. 1. nx = 0 2. for file in dbutils.fs.ls(filePath): 3. if not file.name.endswith(".parquet"): 4. continue 5. df_temp = spark.read.parquet(file.path) 6. if nx == 0: 7. df = df_temp 8. else: 9. df = df.union(df_temp) 10. nx = nx+1 11. df E. 1. nx = 0 2. for file in dbutils.fs.ls(filePath): 3. if not file.name.endswith(".parquet"): 4. continue 5. df_temp = spark.read.parquet(file.path) 6. if nx == 0: 7. df = df_temp 8. else: 9. df = df.join(df_temp, how="outer") 10. nx = nx+1 11. df
Answer: B Explanation: This is a very tricky and involves both knowledge about merging as well as schemas when reading parquet files. spark.read.option("mergeSchema", "true").parquet(filePath) Correct. Spark's DataFrameReader's mergeSchema option will work well here, since columns that appear in both partitions have matching data types. Note that mergeSchema would fail if one or more columns with the same name that appear in both partitions would have different data types. spark.read.parquet(filePath) Incorrect. While this would read in data from both partitions, only the schema in the parquet file that is read in first would be considered, so some columns that appear only in the second partition (e.g. tax_id) would be lost. nx = 0 for file in dbutils.fs.ls(filePath): if not file.name.endswith(".parquet"): continue df_temp = spark.read.parquet(file.path) if nx == 0: df = df_temp else: df = df.union(df_temp) nx = nx+1 df Wrong. The key idea of this solution is the DataFrame.union() command. While this command merges all data, it requires that both partitions have the exact same number of columns with identical data types. spark.read.parquet(filePath, mergeSchema="y") False. While using the mergeSchema option is the correct way to solve this problem and it can even be called with DataFrameReader.parquet() as in the code block, it accepts the value True as a boolean or string variable. But 'y' is not a valid option. nx = 0 for file in dbutils.fs.ls(filePath): if not file.name.endswith(".parquet"): continue df_temp = spark.read.parquet(file.path) if nx == 0: df = df_temp else: df = df.join(df_temp, how="outer") nx = nx+1 df No. This provokes a full outer join. While the resulting DataFrame will have all columns of both partitions, columns that appear in both partitions will be duplicated - the says all columns that are included in the partitions should appear exactly once. More info: Merging different schemas in Apache Spark | by Thiago Cordon | Data Arena | Medium Static notebook | Dynamic notebook: See test 3, (Databricks import instructions)
Question # 5
Which of the following code blocks shows the structure of a DataFrame in a tree-like way, containing
both column names and types?
A. 1. print(itemsDf.columns) 2. print(itemsDf.types) B. itemsDf.printSchema() C. spark.schema(itemsDf) D. itemsDf.rdd.printSchema() E. itemsDf.print.schema()
Answer: B Explanation: itemsDf.printSchema() Correct! Here is an example of what itemsDf.printSchema() shows, you can see the tree-like structure containing both column names and types: root |-- itemId: integer (nullable = true) |-- attributes: array (nullable = true) | |-- element: string (containsNull = true) |-- supplier: string (nullable = true) itemsDf.rdd.printSchema() No, the DataFrame's underlying RDD does not have a printSchema() method. spark.schema(itemsDf) Incorrect, there is no spark.schema command. print(itemsDf.columns) print(itemsDf.dtypes) Wrong. While the output of this code blocks contains both column names and column types, the information is not arranges in a tree-like way. itemsDf.print.schema() No, DataFrame does not have a print method. Static notebook | Dynamic notebook: See test 3, ( Databricks import instructions)
Question # 6
The code block shown below should add column transactionDateForm to DataFrame transactionsDf.
The column should express the unix-format timestamps in column transactionDate as string
type like Apr 26 (Sunday). Choose the answer that correctly fills the blanks in the code block to
accomplish this.
transactionsDf.__1__(__2__, from_unixtime(__3__, __4__))
A. 1. withColumn 2. "transactionDateForm" 3. "MMM d (EEEE)" 4. "transactionDate" B. 1. select 2. "transactionDate" 3. "transactionDateForm" 4. "MMM d (EEEE)" C. 1. withColumn 2. "transactionDateForm" 3. "transactionDate" 4. "MMM d (EEEE)" D. 1. withColumn 2. "transactionDateForm" 3. "transactionDate" 4. "MM d (EEE)" E. 1. withColumnRenamed 2. "transactionDate" 3. "transactionDateForm" 4. "MM d (EEE)"
Answer: C Explanation: Correct code block: transactionsDf.withColumn("transactionDateForm", from_unixtime("transactionDate", "MMM d (EEEE)")) The specifically asks about "adding" a column. In the context of all presented answers, DataFrame.withColumn() is the correct command for this. In theory, DataFrame.select() could also be used for this purpose, if all existing columns are selected and a new one is added. DataFrame.withColumnRenamed() is not the appropriate command, since it can only rename existing columns, but cannot add a new column or change the value of a column. Once DataFrame.withColumn() is chosen, you can read in the documentation (see below) that the first input argument to the method should be the column name of the new column. The final difficulty is the date format. The indicates that the date format Apr 26 (Sunday) is desired. The answers give "MMM d (EEEE)" and "MM d (EEE)" as options. It can be hard to know the details of the date format that is used in Spark. Specifically, knowing the differences between MMM and MM is probably not something you deal with every day. But, there is an easy way to remember the difference: M (one letter) is usually the shortest form: 4 for April. MM includes padding: 04 for April. MMM (three letters) is the three-letter month abbreviation: Apr for April. And MMMM is the longest possible form: April. Knowing this four-letter sequence helps you select the correct option here. More info: pyspark.sql.DataFrame.withColumn ” PySpark 3.1.2 documentation Static notebook | Dynamic notebook: See test 3, (Databricks import instructions)
Question # 7
Which of the following code blocks reads in the JSON file stored at filePath as a DataFrame?
A. spark.read.json(filePath) B. spark.read.path(filePath, source="json") C. spark.read().path(filePath) D. spark.read().json(filePath) E. spark.read.path(filePath)
Answer: A Explanation: spark.read.json(filePath) Correct. spark.read accesses Spark's DataFrameReader. Then, Spark identifies the file type to be read as JSON type by passing filePath into the DataFrameReader.json() method. spark.read.path(filePath) Incorrect. Spark's DataFrameReader does not have a path method. A universal way to read in files is provided by the DataFrameReader.load() method (link below). spark.read.path(filePath, source="json") Wrong. A DataFrameReader.path() method does not exist (see above). spark.read().json(filePath) Incorrect. spark.read is a way to access Spark's DataFrameReader. However, the DataFrameReader is not callable, so calling it via spark.read() will fail. spark.read().path(filePath) No, Spark's DataFrameReader is not callable (see above). More info: pyspark.sql.DataFrameReader.json ” PySpark 3.1.2 documentation, pyspark.sql.DataFrameReader.load ” PySpark 3.1.2 documentation Static notebook | Dynamic notebook: See test 3, ( Databricks import instructions)
Question # 8
The code block displayed below contains an error. The code block should write DataFrame
transactionsDf as a parquet file to location filePath after partitioning it on column storeId. Find the
error.
Code block:
transactionsDf.write.partitionOn("storeId").parquet(filePath)
A. The partitioning column as well as the file path should be passed to the write() method of DataFrame transactionsDf directly and not as appended commands as in the code block. B. The partitionOn method should be called before the write method. C. The operator should use the mode() option to configure the DataFrameWriter so that it replaces any existing files at location filePath. D. Column storeId should be wrapped in a col() operator. E. No method partitionOn() exists for the DataFrame class, partitionBy() should be used instead.
Answer: E Explanation: No method partitionOn() exists for the DataFrame class, partitionBy() should be used instead. Correct! Find out more about partitionBy() in the documentation (linked below). The operator should use the mode() option to configure the DataFrameWriter so that it replaces any existing files at location filePath. No. There is no information about whether files should be overwritten in the question. The partitioning column as well as the file path should be passed to the write() method of DataFrame transactionsDf directly and not as appended commands as in the code block. Incorrect. To write a DataFrame to disk, you need to work with a DataFrameWriter object which you get access to through the DataFrame.writer property - no parentheses involved. Column storeId should be wrapped in a col() operator. No, this is not necessary - the problem is in the partitionOn command (see above). The partitionOn method should be called before the write method. Wrong. First of all partitionOn is not a valid method of DataFrame. However, even assuming partitionOn would be replaced by partitionBy (which is a valid method), this method is a method of DataFrameWriter and not of DataFrame. So, you would always have to first call DataFrame.write to get access to the DataFrameWriter object and afterwards call partitionBy. More info: pyspark.sql.DataFrameWriter.partitionBy ” PySpark 3.1.2 documentation Static notebook | Dynamic notebook: See test 3, ( Databricks import instructions)
Question # 9
Which of the following code blocks creates a new DataFrame with 3 columns, productId, highest, and
lowest, that shows the biggest and smallest values of column value per value in column
productId from DataFrame transactionsDf?
Sample of DataFrame transactionsDf:
1. +-------------+---------+-----+-------+---------+----+
2. |transactionId|predError|value|storeId|productId| f|
3. +-------------+---------+-----+-------+---------+----+
4. | 1| 3| 4| 25| 1|null|
5. | 2| 6| 7| 2| 2|null|
6. | 3| 3| null| 25| 3|null|
7. | 4| null| null| 3| 2|null|
8. | 5| null| null| null| 2|null|
9. | 6| 3| 2| 25| 2|null|
10. +-------------+---------+-----+-------+---------+----+
A. transactionsDf.max('value').min('value') B. transactionsDf.agg(max('value').alias('highest'), min('value').alias('lowest')) C. transactionsDf.groupby(col(productId)).agg(max(col(value)).alias("highest"), min(col(value)).alias("lowest")) D. transactionsDf.groupby('productId').agg(max('value').alias('highest'), min('value').alias('lowest')) E. transactionsDf.groupby("productId").agg({"highest": max("value"), "lowest": min("value")})
Answer: D Explanation: transactionsDf.groupby('productId').agg(max('value').alias('highest'), min('value').alias('lowest')) Correct. groupby and aggregate is a common pattern to investigate aggregated values of groups. transactionsDf.groupby("productId").agg({"highest": max("value"), "lowest": min("value")}) Wrong. While DataFrame.agg() accepts dictionaries, the syntax of the dictionary in this code block is wrong. If you use a dictionary, the syntax should be like {"value": "max"}, so using the column name as the key and the aggregating function as value. transactionsDf.agg(max('value').alias('highest'), min('value').alias('lowest')) Incorrect. While this is valid Spark syntax, it does not achieve what the asks for . The specifically asks for values to be aggregated per value in column productId - this column is not considered here. Instead, the max() and min() values are calculated as if the entire DataFrame was a group. transactionsDf.max('value').min('value') Wrong. There is no DataFrame.max() method in Spark, so this command will fail. transactionsDf.groupby(col(productId)).agg(max(col(value)).alias("highest"), min(col(value)).alias("lowest")) No. While this may work if the column names are expressed as strings, this will not work as is. Python will interpret the column names as variables and, as a result, pySpark will not understand which columns you want to aggregate. More info: pyspark.sql.DataFrame.agg ” PySpark 3.1.2 documentation Static notebook | Dynamic notebook: See test 3, (Databricks import instructions)
Question # 10
Which of the following code blocks returns a DataFrame with approximately 1,000 rows from the
10,000-row DataFrame itemsDf, without any duplicates, returning the same rows even if the code
block is run twice?
A. itemsDf.sampleBy("row", fractions={0: 0.1}, seed=82371) B. itemsDf.sample(fraction=0.1, seed=87238) C. itemsDf.sample(fraction=1000, seed=98263) D. itemsDf.sample(withReplacement=True, fraction=0.1, seed=23536) E. itemsDf.sample(fraction=0.1)
Answer: B Explanation: itemsDf.sample(fraction=0.1, seed=87238) Correct. If itemsDf has 10,000 rows, this code block returns about 1,000, since DataFrame.sample() is never guaranteed to return an exact amount of rows. To ensure you are not returning duplicates, you should leave the withReplacement parameter at False, which is the default. Since thespecifies that the same rows should be returned even if the code block is run twice, you need to specify a seed. The number passed in the seed does not matter as long as it is an integer. itemsDf.sample(withReplacement=True, fraction=0.1, seed=23536) Incorrect. While this code block fulfills almost all requirements, it may return duplicates. This is because withReplacement is set to True. Here is how to understand what replacement means: Imagine you have a bucket of 10,000 numbered balls and you need to take 1,000 balls at random from the bucket (similar to the problem in the question). Now, if you would take those balls with replacement, you would take a ball, note its number, and put it back into the bucket, meaning the next time you take a ball from the bucket there would be a chance you could take the exact same ball again. If you took the balls without replacement, you would leave the ball outside the bucket and not put it back in as you take the next 999 balls. itemsDf.sample(fraction=1000, seed=98263) Wrong. The fraction parameter needs to have a value between 0 and 1. In this case, it should be 0.1, since 1,000,000 = 0.1. itemsDf.sampleBy("row", fractions={0: 0.1}, seed=82371) No, DataFrame.sampleBy() is meant for stratified sampling. This means that based on the values in a column in a DataFrame, you can draw a certain fraction of rows containing those values from the DataFrame (more details linked below). In the scenario at hand, sampleBy is not the right operator to use because you do not have any information about any column that the sampling should depend on. itemsDf.sample(fraction=0.1) Incorrect. This code block checks all the boxes except that it does not ensure that when you run it a second time, the exact same rows will be returned. In order to achieve this, you would have to specify a seed. More info: - pyspark.sql.DataFrame.sample ” PySpark 3.1.2 documentation - pyspark.sql.DataFrame.sampleBy ” PySpark 3.1.2 documentation - Types of Samplings in PySpark 3. The explanations of the sampling¦ | by Pinar Ersoy | Towards Data Science
