Pyspark union dataframe of Technology
pyspark.pandas.DataFrame.pivot. ¶. Return reshaped DataFrame organized by given index / column values. Reshape data (produce a "pivot" table) based on column values. Uses unique values from specified index / columns to form axes of the resulting DataFrame. This function does not support data aggregation.Nearly 190 stores in 30 states have won their union elections. It’s easier to drink Starbucks coffee while supporting unions than it has ever been before. Nearly 190 stores in 30 s...pyspark.sql.DataFrame.crossJoin¶ DataFrame.crossJoin (other: pyspark.sql.dataframe.DataFrame) → pyspark.sql.dataframe.DataFrame¶ Returns the cartesian product with another DataFrame.. Parameters other DataFrame. Right side of the cartesian product. ExamplesPySparkでこういう場合はどうしたらいいのかをまとめた逆引きPySparkシリーズの結合編です。 （随時更新予定です。） 原則としてApache Spark 3.3のPySparkのAPIに準拠していますが、一部、便利なDatabricks限定の機能も利用しています（利用しているところはその旨記載しています）。Jul 8, 2019 · To do a SQL-style set union (that does >deduplication of elements), use this function followed by a distinct. Also as standard in SQL, this function resolves columns by position (not by name). Since Spark >= 2.3 you can use unionByName to union two dataframes were the column names get resolved. edited Jun 20, 2020 at 9:12.Merge and join are two different things in dataframe.According to what I understand from your question join would be the one. joining them as. df1.join(df2, df1.uid1 == df2.uid1).join(df3, df1.uid1 == df3.uid1) should do the trick but I also suggest to change the column names of df2 and df3 dataframes to uid2 and uid3 so that conflict doesn't arise in the futureIn today’s fast-paced world, staying up-to-date with the latest news and information is essential. One trusted source that has been delivering reliable journalism for decades is th...May 24, 2024 · pyspark.sql.DataFrame.show¶ DataFrame.show (n: int = 20, truncate: Union [bool, int] = True, vertical: bool = False) → None¶ Prints the first n rows to the console.. Parameters n int, optional. Number of rows to show. truncate bool or int, optional. If set to True, truncate strings longer than 20 chars by default.If set to a number greater than one, …Add the missing columns to the dataframe (with value 0) for x in cols: if x not in d.columns: dfs[new_name] = dfs[new_name].withColumn(x, lit(0)) dfs[new_name] = dfs[new_name].select(cols) # Use 'select' to get the columns sorted # Now put it al together with a loop (union) result = dfs['df0'] # Take the first dataframe, add the others to it ...how we combine two data frame in pyspark. 2. how to merge 2 or more dataframes with pyspark. 1. ... Pyspark - Union tables with different column names. 2. Pyspark combine dataframes of different length without duplicating. 11. Union list of pyspark dataframes. Hot Network QuestionsMerges a set of updates, insertions, and deletions based on a source table into a target Delta table. This statement is supported only for Delta Lake tables. You would just need to create a new_id that is a join of id_no and start_date. MERGE INTO df1. USING df2. ON df1.new_id = df2.new_id. WHEN MATCHED THEN.So I want to read the csv files from a directory, as a pyspark dataframe and then append them into single dataframe. Not getting the alternative for this in pyspark, the way we do in pandas. For example in Pandas, we do: files=glob.glob(path +'*.csv') df=pd.DataFrame() for f in files: dff=pd.read_csv(f,delimiter=',') df.append(dff)How to do pandas equivalent of pd.concat ( [df1,df2],axis='columns') using Pyspark dataframes? I googled and couldn't find a good solution.The simplest solution is to reduce with union (unionAll in Spark < 2.0):. val dfs = Seq(df1, df2, df3) dfs.reduce(_ union _) This is relatively concise and shouldn't move data from off-heap storage but extends lineage with each union requires non-linear time to perform plan analysis. what can be a problem if you try to merge large number of DataFrames. ...I have used the follwoing methods and although both work on a sample data when on full set it runs for hours and never completes. Method 1: # Filter dtypes and split into column names and type description. cols, dtypes = zip(*((c, t) for (c, t) in df.dtypes if c not in by)) # Spark SQL supports only homogeneous columns.pyspark.sql.DataFrame.columns. ¶. property DataFrame.columns ¶. Retrieves the names of all columns in the DataFrame as a list. The order of the column names in the list reflects their order in the DataFrame. New in version 1.3.0. Changed in version 3.4.0: Supports Spark Connect. Returns. list.May 20, 2016 · To concatenate multiple pyspark dataframes into one: from functools import reduce. df = reduce(lambda x,y:x.union(y), [df_1,df_2]) And you can replace the list of [df_1, df_2] to a list of any length. edited Oct 17, 2023 at 19:36. pasx.DataFrame.withColumn method in pySpark supports adding a new column or replacing existing columns of the same name. In this context you have to deal with Column via - spark udf or when otherwise syntax. for example :Union Row inside Row PySpark Dataframe. 0. union multiple spark dataframes. 1. Pyspark union of two dataframes. 0. How to intersect/union pyspark dataframes with different values. 0. Union for Nested Spark Data Frames. 0. Pyspark - Union two data frames with same column based n same id. 11.PySpark Inner Join DataFrame. The default join in PySpark is the inner join, commonly used to retrieve data from two or more DataFrames based on a shared key. An Inner join combines two DataFrames based on the key (common column) provided and results in rows where there is a matching found. Rows from both DataFrames are dropped with a non ...See also. SparkContext.union() pyspark.sql.DataFrame.union() Examples >>> rdd = sc. parallelize ([1, 1, 2, 3]) >>> rdd. union (rdd). collect [1, 1, 2, 3, 1, 1, 2, 3] ...pyspark.sql.SparkSession.createDataFrame¶ SparkSession.createDataFrame (data, schema = None, samplingRatio = None, verifySchema = True) [source] ¶ Creates a DataFrame from an RDD, a list or a pandas.DataFrame.. When schema is a list of column names, the type of each column will be inferred from data.. When schema is None, it will try to infer the schema (column names and types) from data ...This can be done using a combination of a window function and the Window.unboundedPreceding value in the window's range as follows: from pyspark.sql import Window. from pyspark.sql import functions as F. windowval = (Window.partitionBy('class').orderBy('time') .rangeBetween(Window.unboundedPreceding, 0))pyspark.sql.DataFrame.unionAll. ¶. Return a new DataFrame containing union of rows in this and another DataFrame. New in version 1.3.0. Changed in version 3.4.0: Supports Spark Connect. This is equivalent to UNION ALL in SQL. To do a SQL-style set union (that does deduplication of elements), use this function followed by distinct(). Also as ...pyspark.sql.DataFrame.distinct¶ DataFrame.distinct → pyspark.sql.dataframe.DataFrame¶ Returns a new DataFrame containing the distinct rows in this DataFrame.. Examples >>> df. distinct (). count 2I have about 10,000 different Spark Dataframes that needs to be merged using union, but the union takes a very long time. ... (DataFrame.unionAll, dfs) It seems that when I union 100-200 dataframes, it is quite fast. ... How to intersect/union pyspark dataframes with different values. 0. Union for Nested Spark Data Frames. 11.pyspark.sql.DataFrame.unionByName. ¶. Returns a new DataFrame containing union of rows in this and another DataFrame. This is different from both UNION ALL and UNION DISTINCT in SQL. To do a SQL-style set union (that does deduplication of elements), use this function followed by distinct(). New in version 2.3.0.In addition to the above, you can also use Koalas (available in databricks) and is similar to Pandas except makes more sense for distributed processing and available in Pyspark (from 3.0.0 onwards). Something as below -. kdf = df.to_koalas() Transpose_kdf = kdf.transpose() TransposeDF = Transpose_kdf.to_spark() Koalas documentation - Databricks ...intersection and union of two pyspark dataframe on the basis of a common column. 4. Check if value from one dataframe column exists in another dataframe column using Spark Scala. 1. Intersection of two data frames with different columns in Pyspark. 2.pyspark.sql.DataFrame.unionByName. ¶. Returns a new DataFrame containing union of rows in this and another DataFrame. This is different from both UNION ALL and UNION DISTINCT in SQL. To do a SQL-style set union (that does deduplication of elements), use this function followed by distinct(). New in version 2.3.0.I am creating an empty dataframe and later trying to append another data frame to that. In fact I want to append many dataframes to the initially empty dataframe dynamically depending on number of RDDs coming. the union() function works fine if I assign the value to another a third dataframe. val df3=df1.union(df2)pyspark.sql.DataFrame A distributed collection of data grouped into named columns. pyspark.sql.Column A column expression in a DataFrame. pyspark.sql.Row A row of data in a DataFrame. pyspark.sql.GroupedData Aggregation methods, returned by DataFrame.groupBy(). pyspark.sql.DataFrameNaFunctions Methods for handling missing data (null values).I have about 10,000 different Spark Dataframes that needs to be merged using union, ... (DataFrame.unionAll, dfs) It seems that when I union 100-200 dataframes, ... How to intersect/union pyspark dataframes with different values. 0. Union for Nested Spark Data Frames. 11.Concatenate row values based on group by in pyspark data frame. 2. Merging column with array from multiple rows. 1. Group by and aggregate on a column with array in PySpark. Hot Network Questions Reconstruct a long division given less than a quarter of the digits, and all of those are wrongEmployers resist unions for a number of reasons, but the biggest reason is that unions force employers to have less control. With a union, workers can organize, gain power, and lim...pyspark.sql.DataFrameWriter.orc. ¶. Saves the content of the DataFrame in ORC format at the specified path. New in version 1.5.0. Changed in version 3.4.0: Supports Spark Connect. specifies the behavior of the save operation when data already exists. append: Append contents of this DataFrame to existing data. overwrite: Overwrite existing data.The pyspark.sql.DataFrame.unionByName() to merge/union two DataFrames with column names. In PySpark you can easily achieve this using unionByName() transformation, this function also takes param allowMissingColumns with the value True if you have a different number of columns on two DataFrames.I am just looking at one day at a time which is why I didnt have the date in the dataframe. at any one time frame, there is at most 4 professors and 4 students. this dataframe just shows one time frame. but for the next time frame it is possible that the 4 professors are p5, p1, p7, p9 or something like that. the students might still be s1, s2 ...Are you in the market for a new car? If so, it’s important to understand your auto loan and financing options. One institution that offers excellent options for residents of Colora...pyspark.sql.functions.array_union(col1, col2) [source] ¶. Collection function: returns an array of the elements in the union of col1 and col2, without duplicates. New in version 2.4.0. Parameters.This post shows the different ways to combine multiple PySpark arrays into a single array. These operations were difficult prior to Spark 2.4, but now there are built-in functions that make combining arrays easy. concat. concat joins two array columns into a single array. Creating a DataFrame with two array columns so we can demonstrate with an ...The Basics of Union Operation. The Union operation in PySpark is used to merge two DataFrames with the same schema. It stacks the rows of the second DataFrame on top of the first DataFrame, effectively concatenating the DataFrames vertically. The result is a new DataFrame containing all the rows from both input DataFrames.22 Answers. Sorted by: 80. Spark 3.1+. df = df1.unionByName(df2, allowMissingColumns=True) Test results: from pyspark.sql import SparkSession. spark …col (col). Returns a Column based on the given column name.. column (col). Returns a Column based on the given column name.. lit (col). Creates a Column of literal value.. broadcast (df). Marks a DataFrame as small enough for use in broadcast joins. coalesce (*cols). Returns the first column that is not null.Note. This method should only be used if the resulting pandas DataFrame is expected to be small, as all the data is loaded into the driver's memory. Parameters. orientstr {'dict', 'list', 'series', 'split', 'records', 'index'} Determines the type of the values of the dictionary. 'dict' (default) : dict like {column ... Jul 8, 2019 · To do a SQL-style set union (that dThis method performs a SQL-style set union of the rows fpyspark.sql.DataFrame.crossJoin¶ DataFrame
Health Tips for Traveller winch wiring diagram
PySpark是Spark的Python编程接口，为Python开发者提供了使用Spark进行数据处理和分析的能力。 阅读更多：PySpark 教程. 理解union操作. 在开始之前，让我们先了解一下union操作是什么。在Spark中，union操作是将两个DataFrame合并为一个DataFrame的一种方法。pyspark.sql.functions.array_union(col1, col2) [source] ¶. Collection function: returns an array of the elements in the union of col1 and col2, without duplicates. New in version 2.4.0. Parameters.I am trying to find out the size/shape of a DataFrame in PySpark. I do not see a single function that can do this. In Python, I can do this: data.shape() Is there a similar function in PySpark? This is my current solution, but I am looking for an element one.UnionByName with Missing Columns. The second use case for unionByName is when one of our dataframes has missing columns. Let's drop a column from our second dataframe and add the allowMissingColumns property to our unionByName call. df2_dropped = df2.drop('unique_products_sold') df2_dropped.show()I would like to make a union operation on multiple structured streaming dataframe, connected to kafka topics, in order to watermark them all at the same moment.Actions: These operations return a value to the driver program or write data to an external storage system. Actions trigger the execution of the plan built by transformations. Examples include collect, count, and saveAsTextFile. Now that we've brushed up on RDD basics, let's dive into a real-life PySpark scenario: 1. Creation of SparkContext:pyspark.sql.DataFrame.count¶ DataFrame.count → int [source] ¶ Returns the number of rows in this DataFrame.pyspark.sql.DataFrame.join. ¶. Joins with another DataFrame, using the given join expression. New in version 1.3.0. Changed in version 3.4.0: Supports Spark Connect. Right side of the join. a string for the join column name, a list of column names, a join expression (Column), or a list of Columns. If on is a string or a list of strings ...PySpark offers several storage levels for persisting DataFrames, each with its own trade-offs in terms of speed, memory usage, and fault tolerance: 1. MEMORY_ONLY. This storage level stores DataFrame partitions in memory only, without replication. It is the fastest storage level but offers no fault tolerance. 2.PySpark Union is an operation that allows you to combine two or more DataFrames with the same schema, creating a single DataFrame containing all rows from the input DataFrames. It’s important to note that the Union operation doesn’t eliminate duplicate rows, so you may need to use the distinct() function afterward if you want to remove …I am creating an empty dataframe and later trying to append another data frame to that. In fact I want to append many dataframes to the initially empty dataframe dynamically depending on number of RDDs coming. the union() function works fine if I assign the value to another a third dataframe. val df3=df1.union(df2)pyspark.sql.DataFrameReader.json. ¶. Loads JSON files and returns the results as a DataFrame. JSON Lines (newline-delimited JSON) is supported by default. For JSON (one record per file), set the multiLine parameter to true. If the schema parameter is not specified, this function goes through the input once to determine the input schema.pyspark.sql.DataFrame.union. ¶. Return a new DataFrame containing union of rows in this and another DataFrame. This is equivalent to UNION ALL in SQL. To do a SQL-style set union (that does deduplication of elements), use this function followed by distinct(). Also as standard in SQL, this function resolves columns by position (not by name ...pyspark.sql.DataFrame.schema¶ property DataFrame.schema¶. Returns the schema of this DataFrame as a pyspark.sql.types.StructType.pyspark.sql.DataFrame.union. ¶. Return a new DataFrame containing union of rows in this and another DataFrame. This is equivalent to UNION ALL in SQL. To do a SQL-style set union (that does deduplication of elements), use this function followed by distinct().Output a Python RDD of key-value pairs (of form RDD[(K, V)]) to any Hadoop file system, using the "org.apache.hadoop.io.Writable" types that we convert from the RDD's key and value types. saveAsTextFile (path [, compressionCodecClass]) Save this RDD as a text file, using string representations of elements.Step 3: Union Pandas DataFrames using Concat. Finally, to union the two Pandas DataFrames together, you may use: Copy. pd.concat([df1, df2]) Here is the complete Python code to union the Pandas DataFrames using concat (note that you'll need to keep the same column names across all the DataFrames to avoid any NaN values ): Copy.We would like to show you a description here but the site won’t allow us.pyspark.sql.DataFrameWriter.save. ¶. Saves the contents of the DataFrame to a data source. The data source is specified by the format and a set of options . If format is not specified, the default data source configured by spark.sql.sources.default will be used. New in version 1.4.0. Changed in version 3.4.0: Supports Spark Connect.Syntax. dataFrame1.unionAll(dataFrame2) Note: In other SQL languages, Union eliminates the duplicates but UnionAll merges two datasets including duplicate records. But, in PySpark both behave the same and recommend using DataFrame duplicate () function to remove duplicate rows. First, let's create two DataFrame with the same schema.pyspark.sql.functions.struct¶ pyspark.sql.functions.struct (* cols: Union[ColumnOrName, List[ColumnOrName_], Tuple[ColumnOrName_, …]]) → pyspark.sql.column ...Spark has a lazy execution it means that it reads the input bit by bit, so the input dir has to be different from the output dir, you need to save in some other location and then remove the old dir and move the new one the old locationLearn how to use PySpark Union operation to merge multiple DataFrames with the same schema, creating a single DataFrame containing all rows. See examples of unioning two …I have the following few data frames which have two columns each and have exactly the same number of rows. How do I join them so that I get a single data frame which has the two columns and all rows from both the data frames?1. I have written a snippet to do the following: 1. Take n rows for each strata from a dataframe (df1) 2. Rank order the rows by strata 3. Replace data in one of the columns with data from another data frame (df2) 4. Union both the dataframe (df1 and df2) I understand that unionall is an expensive operation in spark.pyspark.sql.DataFrame.describe. ¶. Computes basic DataFrame.stack() → Union [ DataFrame, S
Top Travel Destinations in 2024
In today’s fast-paced world, staying up-to-date with the latest news and information is essential. One trusted source that has been delivering reliable journalism for decades is th...pyspark.sql.functions.shuffle(col) [source] ¶. Collection function: Generates a random permutation of the given array. New in version 2.4.0. Parameters. col Column or str. name of column or expression. Notes. The function is non-deterministic. Examples.def unionPro(DFList: List[DataFrame], caseDiff: str = "N") -> DataFrame: """ :param DFList: :param caseDiff: :return: This Function Accepts DataFrame with same or Different Schema/Column Order.With some or none common columns Creates a Unioned DataFrame """ inputDFList = DFList if caseDiff == "N" else [df.select([F.col(x.lower) for x in df ...pyspark.sql.DataFrame.unionByName. ¶. Returns a new DataFrame containing union of rows in this and another DataFrame. This is different from both UNION ALL and UNION DISTINCT in SQL. To do a SQL-style set union (that does deduplication of elements), use this function followed by distinct(). New in version 2.3.0.RDD.union(other: pyspark.rdd.RDD[U]) → pyspark.rdd.RDD [ Union [ T, U]] [source] ¶pyspark.sql.DataFrame.unionByName. ¶. Returns a new DataFrame containing union of rows in this and another DataFrame. This is different from both UNION ALL and UNION DISTINCT in SQL. To do a SQL-style set union (that does deduplication of elements), use this function followed by distinct(). New in version 2.3.0.pyspark.sql.functions.array_distinct¶ pyspark.sql.functions.array_distinct (col: ColumnOrName) → pyspark.sql.column.Column [source] ¶ Collection function: removes ...DataFrameWriter.partitionBy(*cols: Union[str, List[str]]) → pyspark.sql.readwriter.DataFrameWriter [source] ¶. Partitions the output by the given columns on the file system. If specified, the output is laid out on the file system similar to Hive's partitioning scheme. New in version 1.4.0.DataFrame.median ( [axis, skipna, …]) Return the median of the values for the requested axis. DataFrame.mode ( [axis, numeric_only, dropna]) Get the mode (s) of each element along the selected axis. DataFrame.pct_change ( [periods]) Percentage change between the current and a prior element.Union. The union function in PySpark is used to combine two DataFrames or Datasets with the same schema. It returns a new DataFrame that contains all the rows from both input DataFrames. Syntax. The syntax for using the union function is as follows:. union (other). Where: other: The DataFrame or Dataset to be combined with the current …This post shows the different ways to combine multiple PySpark arrays into a single array. These operations were difficult prior to Spark 2.4, but now there are built-in functions that make combining arrays easy. concat. concat joins two array columns into a single array. Creating a DataFrame with two array columns so we can demonstrate with an ...I am just looking at one day at a time which is why I didnt have the date in the dataframe. at any one time frame, there is at most 4 professors and 4 students. this dataframe just shows one time frame. but for the next time frame it is possible that the 4 professors are p5, p1, p7, p9 or something like that. the students might still be s1, s2 ...This function is useful to massage a DataFrame into a format where some columns are identifier columns (“ids”), while all other columns (“values”) are “unpivoted” to the rows, leaving just two non-id columns, named as given by variableColumnName and valueColumnName. When no “id” columns are given, the unpivoted DataFrame ...pyspark.sql.DataFrame.dropDuplicates. ¶. Return a new DataFrame with duplicate rows removed, optionally only considering certain columns. For a static batch DataFrame, it just drops duplicate rows. For a streaming DataFrame, it will keep all data across triggers as intermediate state to drop duplicates rows. You can use withWatermark() to ...pyspark.sql.DataFrame.groupBy¶ DataFrame.groupBy (* cols: ColumnOrName) → GroupedData¶ Groups the DataFrame using the specified columns, so we can run aggregation on them. See GroupedData for all the available aggregate functions.. groupby() is an alias for groupBy(). Parameters cols list, str or Column. columns to group by. Each element should be a column name (string) or an expression ...Could anyone let me know how to convert a dictionary into a spark dataframe in PySpark ? python; apache-spark; pyspark; Share. Follow asked Apr 21, 2020 at 8:56. Metadata Metadata. 2,071 11 11 gold badges 65 65 silver badges 142 142 bronze badges. Add a comment |May 24, 2024 · pyspark.sql.DataFrame.persist¶ DataFrame.persist (storageLevel: pyspark.storagelevel.StorageLevel = StorageLevel(True, True, False, True, 1)) → pyspark.sql.dataframe.DataFrame¶ Sets the storage level to persist the contents of the DataFrame across operations after the first time it is computed. This can only be used to …In the ever-evolving landscape of journalism, local newspapers play a vital role in keeping communities informed about important news and events. One such publication that has beco...1. I want to do the union of two pyspark dataframe. They have same columns but sequence of columns are different. I tried this. joined_df = A_df.unionAll(B_DF) But result is based on column sequence and intermixing the results. IS there a way to do do the union based on columns name and not based on the order of columns. Thanks in advance.from pyspark.sql import SparkSession from pyspark.sql.functions import explode from pyspark.sql.functions import split spark ... # Create DataFrame representing the stream of input lines from connection to localhost:9999 lines ... A session window's range is the union of all events' ranges which are determined by event start time and ...DataFrame.unionByName(other: pyspark.sql.dataframe.DataFrame, allowMissingColumns: bool = False) → pyspark.sql.dataframe.DataFrame ¶. Returns a new DataFrame containing union of rows in this and another DataFrame. This is different from both UNION ALL and UNION DISTINCT in SQL. To do a SQL-style set union (that does deduplication of elements ...pyspark.sql.DataFrame.coalesce¶ DataFrame.coalesce (numPartitions: int) → pyspark.sql.dataframe.DataFrame [source] ¶ Returns a new DataFrame that has exactly numPartitions partitions.. Similar to coalesce defined on an RDD, this operation results in a narrow dependency, e.g. if you go from 1000 partitions to 100 partitions, there will not be a shuffle, instead each of the 100 new ...I am just looking at one day at a time which is why I didnt have the date in the dataframe. at any one time frame, there is at most 4 professors and 4 students. this dataframe just shows one time frame. but for the next time frame it is possible that the 4 professors are p5, p1, p7, p9 or something like that. the students might still be s1, s2 ...Returns a new DataFrame containing union of rows in this and another DataFrame. DataFrame.unpersist ([blocking]) Marks the DataFrame as non-persistent, and remove all blocks for it from memory and disk. DataFrame.unpivot (ids, values, …) Unpivot a DataFrame from wide format to long format, optionally leaving identifier columns set. DataFrame ...Its demo dataframe thats why i only show one column, but in my real dataframe there is more then one column, so i need that record that also have null values. - Sohel Reza Oct 17, 2019 at 8:20You can use the following syntax to perform a union on two PySpark DataFrames that contain different columns: df_union = df1.unionByName(df2, allowMissingColumns=True) This particular example performs a union between the PySpark DataFrames named df1 and df2. By using the argument allowMissingColumns=True, we specify that the set of column names ...SparkContext.union(rdds: List[pyspark.rdd.RDD[T]]) → pyspark.rdd.RDD [ T] [source] ¶. Build the union of a list of RDDs. This supports unions () of RDDs with different serialized formats, although this forces them to be reserialized using the default serializer: New in version 0.7.0. See also.pyspark.sql.DataFrame.crossJoin¶ DataFrame.crossJoin (other: pyspark.sql.dataframe.DataFrame) → pyspark.sql.dataframe.DataFrame¶ Returns the cartesian product with another DataFrame.. Parameters other DataFrame. Right side of the cartesian product. Examples Index of the right DataFrame if merged only on the index of