{"id":130,"date":"2022-04-28T16:38:48","date_gmt":"2022-04-28T16:38:48","guid":{"rendered":"https:\/\/gauthamit.com\/blog\/?p=130"},"modified":"2022-05-20T04:03:48","modified_gmt":"2022-05-20T04:03:48","slug":"adf-interview-questions","status":"publish","type":"post","link":"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/","title":{"rendered":"ADF Interview Questions"},"content":{"rendered":"<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_68 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title \" >Table of Contents<\/p>\n<span class=\"ez-toc-title-toggle\"><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#ADF_Interview_Questions\" title=\"ADF Interview Questions\">ADF Interview Questions<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#1Why_do_we_need_Azure_Data_Factory\" title=\"1.Why do we need Azure Data Factory?\">1.Why do we need Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#2What_is_Azure_Data_Factory\" title=\"2.What is Azure Data Factory?\">2.What is Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-4\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#3What_is_Integration_Runtime\" title=\"3.What is Integration Runtime?\">3.What is Integration Runtime?<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-5\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#Types_of_Integration_Runtimes\" title=\"Types of Integration Runtimes:\">Types of Integration Runtimes:<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-6\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#4How_much_is_the_limit_on_the_number_of_integration_runtimes\" title=\"4.How much is the limit on the number of integration runtimes?\">4.How much is the limit on the number of integration runtimes?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-7\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#5What_is_the_difference_between_Azure_Data_Lake_and_Azure_Data_Warehouse\" title=\"5.What is the difference between Azure Data Lake and Azure Data Warehouse?\">5.What is the difference between Azure Data Lake and Azure Data Warehouse?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-8\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#6What_is_Blob_Storage_in_Azure\" title=\"6.What is Blob Storage in Azure?\">6.What is Blob Storage in Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-9\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#7Difference_between_Data_Lake_Storage_and_Blob_Storage\" title=\"7.Difference between Data Lake Storage and Blob Storage\">7.Difference between Data Lake Storage and Blob Storage<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-10\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#8What_are_the_steps_to_create_an_ETL_process_in_Azure_Data_Factory\" title=\"8.What are the steps to create an ETL process in Azure Data Factory\">8.What are the steps to create an ETL process in Azure Data Factory<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-11\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#9What_is_the_difference_between_Azure_HDInsight_and_Azure_Data_Lake_Analytics\" title=\"9.What is the difference between Azure HDInsight and Azure Data Lake Analytics?\">9.What is the difference between Azure HDInsight and Azure Data Lake Analytics?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-12\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#10What_are_the_top-level_concepts_of_Azure_Data_Factory\" title=\"10.What are the top-level concepts of Azure Data Factory?\">10.What are the top-level concepts of Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-13\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#11How_can_we_schedule_a_pipeline\" title=\"11.How can we schedule a pipeline?\">11.How can we schedule a pipeline?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-14\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#12Can_we_pass_parameters_to_a_pipeline_run\" title=\"12.Can we pass parameters to a pipeline run?\">12.Can we pass parameters to a pipeline run?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-15\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#13How_do_I_access_the_data_using_the_other_80_Dataset_types_in_Data_Factory\" title=\"13.How do I access the data using the other 80 Dataset types in Data Factory?\">13.How do I access the data using the other 80 Dataset types in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-16\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#14Explain_the_two_levels_of_security_in_ADLS_Gen2\" title=\"14.Explain the two levels of security in ADLS Gen2?\">14.Explain the two levels of security in ADLS Gen2?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-17\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#15What_has_changed_from_private_preview_to_limited_public_preview_regarding_data_flows\" title=\"15.What has changed from private preview to limited public preview regarding data flows?\">15.What has changed from private preview to limited public preview regarding data flows?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-18\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#16What_is_the_difference_between_the_Dataset_and_Linked_Service_in_Data_Factory\" title=\"16.What is the difference between the Dataset and Linked Service in Data Factory?\">16.What is the difference between the Dataset and Linked Service in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-19\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#17What_is_the_difference_between_the_mapping_data_flow_and_wrangling_data_flow_transformation\" title=\"17.What is the difference between the mapping data flow and wrangling data flow transformation?\">17.What is the difference between the mapping data flow and wrangling data flow transformation?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-20\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#18Data_Factory_supports_two_types_of_compute_environments_to_execute_the_transform_activities_Mention_them_briefly\" title=\"18.Data Factory supports two types of compute environments to execute the transform activities. Mention them briefly.\">18.Data Factory supports two types of compute environments to execute the transform activities. Mention them briefly.<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-21\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#19What_is_Azure_SSIS_Integration_Runtime\" title=\"19.What is Azure SSIS Integration Runtime?\">19.What is Azure SSIS Integration Runtime?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-22\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#20What_is_required_to_execute_an_SSIS_package_in_Data_Factory\" title=\"20.What is required to execute an SSIS package in Data Factory?\">20.What is required to execute an SSIS package in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-23\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#21An_Azure_Data_Factory_Pipeline_can_be_executed_using_three_methods_Mention_these_methods\" title=\"21.An Azure Data Factory Pipeline can be executed using three methods. Mention these methods.\">21.An Azure Data Factory Pipeline can be executed using three methods. Mention these methods.<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-24\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#22If_we_need_to_copy_data_from_an_on-premises_SQL_Server_instance_using_a_data_factory_which_integration_runtime_should_be_used\" title=\"22.If we need to copy data from an on-premises SQL Server instance using a data factory, which integration runtime should be used?\">22.If we need to copy data from an on-premises SQL Server instance using a data factory, which integration runtime should be used?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-25\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#23An_Azure_Data_Factory_Pipeline_can_be_executed_using_three_methods_Mention_these_methods\" title=\"23.An Azure Data Factory Pipeline can be executed using three methods. Mention these methods.\">23.An Azure Data Factory Pipeline can be executed using three methods. Mention these methods.<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-26\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#24What_is_Azure_Table_Storage\" title=\"24.What is Azure Table Storage?\">24.What is Azure Table Storage?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-27\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#_25Can_we_monitor_and_manage_Azure_Data_Factory_Pipelines\" title=\"\u00a025.Can we monitor and manage Azure Data Factory Pipelines?\">\u00a025.Can we monitor and manage Azure Data Factory Pipelines?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-28\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#26What_are_the_steps_involved_in_the_ETL_process\" title=\"26.What are the steps involved in the ETL process?\">26.What are the steps involved in the ETL process?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-29\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#27What_do_we_understand_by_Integration_Runtime\" title=\"27.What do we understand by Integration Runtime?\">27.What do we understand by Integration Runtime?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-30\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#28What_is_the_difference_between_Azure_Data_Lake_and_Azure_Data_Warehouse\" title=\"28.What is the difference between Azure Data Lake and Azure Data Warehouse?\">28.What is the difference between Azure Data Lake and Azure Data Warehouse?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-31\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#29Describe_the_process_to_create_an_ETL_process_in_Azure_Data_Factory\" title=\"29.Describe the process to create an ETL process in Azure Data Factory?\">29.Describe the process to create an ETL process in Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-32\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#30What_are_the_top-level_concepts_of_Azure_Data_Factory\" title=\"30.What are the top-level concepts of Azure Data Factory?\">30.What are the top-level concepts of Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-33\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#31How_can_we_schedule_a_pipeline\" title=\"31.How can we schedule a pipeline?\">31.How can we schedule a pipeline?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-34\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#32Is_there_any_way_to_pass_parameters_to_a_pipeline_run\" title=\"32.Is there any way to pass parameters to a pipeline run?\">32.Is there any way to pass parameters to a pipeline run?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-35\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#33_What_is_the_difference_between_the_mapping_data_flow_and_wrangling_data_flow_transformation\" title=\"33. What is the difference between the mapping data flow and wrangling data flow transformation?\">33. What is the difference between the mapping data flow and wrangling data flow transformation?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-36\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#34Is_there_any_way_to_pass_parameters_to_a_pipeline_run\" title=\"34.Is there any way to pass parameters to a pipeline run?\">34.Is there any way to pass parameters to a pipeline run?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-37\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#35Explain_the_two_levels_of_security_in_ADLS_Gen2\" title=\"35.Explain the two levels of security in ADLS Gen2?\">35.Explain the two levels of security in ADLS Gen2?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-38\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#36What_has_changed_from_private_preview_to_limited_public_preview_regarding_data_flows\" title=\"36.What has changed from private preview to limited public preview regarding data flows?\">36.What has changed from private preview to limited public preview regarding data flows?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-39\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#37Data_Factory_supports_two_types_of_compute_environments_to_execute_the_transform_activities_What_are_those\" title=\"37.Data Factory supports two types of compute environments to execute the transform activities. What are those?\">37.Data Factory supports two types of compute environments to execute the transform activities. What are those?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-40\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#_38Can_an_activity_output_property_be_consumed_in_another_activity\" title=\"\u00a038.Can an activity output property be consumed in another activity?\">\u00a038.Can an activity output property be consumed in another activity?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-41\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#39What_is_the_way_to_access_data_by_using_the_other_90_dataset_types_in_Data_Factory\" title=\"39.What is the way to access data by using the other 90 dataset types in Data Factory?\">39.What is the way to access data by using the other 90 dataset types in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-42\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#40Is_it_possible_to_calculate_a_value_for_a_new_column_from_the_existing_column_from_mapping_in_ADF\" title=\"40.Is it possible to calculate a value for a new column from the existing column from mapping in ADF?\">40.Is it possible to calculate a value for a new column from the existing column from mapping in ADF?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-43\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#41What_is_the_way_to_parameterize_column_name_in_dataflow\" title=\"41.What is the way to parameterize column name in dataflow?\">41.What is the way to parameterize column name in dataflow?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-44\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#42In_what_way_we_can_write_attributes_in_cosmos_DB_in_the_same_order_as_specified_in_the_sink_in_ADF_data_flow\" title=\"42.In what way we can write attributes in cosmos DB in the same order as specified in the sink in ADF data flow?\">42.In what way we can write attributes in cosmos DB in the same order as specified in the sink in ADF data flow?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-45\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#43What_are_the_Pipelines_and_Activities_in_Azure_Data_Factory\" title=\"43.What are the Pipelines and Activities in Azure Data Factory?\">43.What are the Pipelines and Activities in Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-46\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#44What_are_Datasets_in_ADF\" title=\"44.What are Datasets in ADF?\">44.What are Datasets in ADF?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-47\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#45Explain_Integration_Runtime_in_the_Data_Factory\" title=\"45.Explain Integration Runtime in the Data Factory?\">45.Explain Integration Runtime in the Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-48\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#46How_does_ADF_Pipeline_execution_work\" title=\"46.How does ADF Pipeline execution work?\">46.How does ADF Pipeline execution work?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-49\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#47What_are_Triggers_in_a_Data_Factory\" title=\"47.What are Triggers in a Data Factory?\">47.What are Triggers in a Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-50\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#48What_is_azure_data_factory_used_for\" title=\"48.What is azure data factory used for ?\">48.What is azure data factory used for ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-51\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#49What_is_the_pipeline_in_the_adf\" title=\"49.What is the pipeline in the adf ?\">49.What is the pipeline in the adf ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-52\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#50What_is_the_data_source_in_the_azure_data_factory\" title=\"50.What is the data source in the azure data factory ?\">50.What is the data source in the azure data factory ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-53\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#51What_is_the_integration_runtime_in_Azure_data_factory\" title=\"51.What is the integration runtime in Azure data factory :\">51.What is the integration runtime in Azure data factory :<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-54\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#52What_is_Azure_Integration_Runtime\" title=\"52.What is Azure Integration Runtime ?\">52.What is Azure Integration Runtime ?<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-55\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#AutoResolveIntegrationRuntime\" title=\"AutoResolveIntegrationRuntime.\">AutoResolveIntegrationRuntime.<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-56\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#53What_are_the_different_types_of_integration_runtime\" title=\"53.What are the different types of integration runtime ?\">53.What are the different types of integration runtime ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-57\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#54What_is_use_of_lookup_activity_in_azure_data_factory\" title=\"54.What is use of lookup activity in azure data factory ?\">54.What is use of lookup activity in azure data factory ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-58\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#55What_is_the_main_advantage_of_the_Auto_Resolve_Integration_Runtime\" title=\"55.What is the main advantage of the Auto Resolve Integration Runtime ?\">55.What is the main advantage of the Auto Resolve Integration Runtime ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-59\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#56What_is_copy_activity_in_azure_data_factory\" title=\"56.What is copy activity in azure data factory\">56.What is copy activity in azure data factory<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-60\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#57What_do_you_mean_by_variables_in_the_azure_data_factory\" title=\"57.What do you mean by variables in the azure data factory ?\">57.What do you mean by variables in the azure data factory ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-61\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#58What_is_the_linked_service_in_the_azure_data_factory\" title=\"58.What is the linked service in the azure data factory ?\">58.What is the linked service in the azure data factory ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-62\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#59What_is_the_Dataset_in_the_adf\" title=\"59.What is the Dataset in the adf ?\">59.What is the Dataset in the adf ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-63\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#60Can_we_debug_the_pipeline\" title=\"60.Can we debug the pipeline ?\">60.Can we debug the pipeline ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-64\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#61What_are_the_steps_invovled_in_ETL_process\" title=\"61.What are the steps invovled in ETL process?\">61.What are the steps invovled in ETL process?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-65\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#62What_is_Cloud_Computing\" title=\"62.What is Cloud Computing?\">62.What is Cloud Computing?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-66\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#63What_are_the_advantages_of_Cloud_Computing\" title=\"63.What are the advantages of Cloud Computing?\">63.What are the advantages of Cloud Computing?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-67\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#64Can_we_Monitor_and_manage_Azure_Data_Factory_pipelines\" title=\"64.Can we Monitor and manage Azure Data Factory pipelines?\">64.Can we Monitor and manage Azure Data Factory pipelines?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-68\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#65What_is_Azure_Table_Storage\" title=\"65.What is Azure Table Storage?\">65.What is Azure Table Storage?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-69\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#66What_are_Azure_Storage_Types\" title=\"66.What are Azure Storage Types?\">66.What are Azure Storage Types?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-70\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#67Difference_between_mapping_and_wrangling_data_flows\" title=\"67.Difference between mapping and wrangling data flows?\">67.Difference between mapping and wrangling data flows?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-71\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#68Limit_on_the_number_of_integration_runtimes\" title=\"68.Limit on the number of integration runtimes?\">68.Limit on the number of integration runtimes?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-72\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#69What_is_Azure_Active_Directory_and_what_is_its_purpose\" title=\"69.What is Azure Active Directory and what is its purpose?\">69.What is Azure Active Directory and what is its purpose?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-73\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#70What_is_Azure_Redis_Cache_and_how_to_implement_it\" title=\"70.What is Azure Redis Cache and how to implement it?\">70.What is Azure Redis Cache and how to implement it?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-74\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#71How_to_create_and_connect_to_Azure_SQL_Database\" title=\"71.How to create and connect to Azure SQL Database?\">71.How to create and connect to Azure SQL Database?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-75\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#72What_is_Azure_SQL_Data_Warehouse\" title=\"72.What is Azure SQL Data Warehouse?\">72.What is Azure SQL Data Warehouse?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-76\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#73Can_you_create_a_Virtual_Machine_in_Azure\" title=\"73.Can you create a Virtual Machine in Azure?\">73.Can you create a Virtual Machine in Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-77\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#74What_is_CosmosDB\" title=\"74.What is CosmosDB?\">74.What is CosmosDB?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-78\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#75What_is_Blob\" title=\"75.What is Blob?\">75.What is Blob?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-79\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#76Why_do_we_use_Blob\" title=\"76.Why do we use Blob?\">76.Why do we use Blob?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-80\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#77What_Is_Azure_Databricks\" title=\"77.What Is Azure Databricks?\">77.What Is Azure Databricks?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-81\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#78What_is_Azure_Advisor\" title=\"78.What is Azure Advisor?\">78.What is Azure Advisor?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-82\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#79What_are_Azure_App_Services\" title=\"79.What are Azure App Services?\">79.What are Azure App Services?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-83\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#80What_Is_Azure_Kubernetes_Service\" title=\"80.What Is Azure Kubernetes Service?\">80.What Is Azure Kubernetes Service?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-84\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#81I_have_some_private_servers_on_my_premises_also_I_have_distributed_some_of_my_workload_on_the_public_cloud_what_is_this_architecture_called\" title=\"81.I have some private servers on my premises, also I have distributed some of my workload on the public cloud, what is this architecture called?\">81.I have some private servers on my premises, also I have distributed some of my workload on the public cloud, what is this architecture called?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-85\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#82What_is_Microsoft_Azure_and_why_is_it_used\" title=\"82.What is Microsoft Azure and why is it used?\">82.What is Microsoft Azure and why is it used?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-86\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#83Which_service_in_Azure_is_used_to_manage_resources_in_Azure\" title=\"83.Which service in Azure is used to manage resources in Azure?\">83.Which service in Azure is used to manage resources in Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-87\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#84_What_are_Roles_and_why_do_we_use_them\" title=\"84. What are Roles and why do we use them?\">84. What are Roles and why do we use them?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-88\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#85_Is_it_possible_to_create_a_Virtual_Machine_using_Azure_Resource_Manager_in_a_Virtual_Network_that_was_created_using_classic_deployment\" title=\"85. Is it possible to create a Virtual Machine using Azure Resource Manager in a Virtual Network that was created using classic deployment?\">85. Is it possible to create a Virtual Machine using Azure Resource Manager in a Virtual Network that was created using classic deployment?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-89\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#86_Are_data_disks_supported_within_scale_sets\" title=\"86. Are data disks supported within scale sets?\">86. Are data disks supported within scale sets?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-90\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#87_What_is_an_Availability_Set\" title=\"87 .What is an Availability Set?\">87 .What is an Availability Set?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-91\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#88What_are_Fault_Domains\" title=\"88.What are Fault Domains?\">88.What are Fault Domains?<\/a><ul class='ez-toc-list-level-3' ><li class='ez-toc-heading-level-3'><a class=\"ez-toc-link ez-toc-heading-92\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#89What_are_Update_Domains\" title=\"89.What are Update Domains?\">89.What are Update Domains?<\/a><\/li><\/ul><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-93\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#90What_is_a_cloud_environment\" title=\"90.What is a cloud environment?\">90.What is a cloud environment?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-94\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#91Why_do_we_need_Cloud\" title=\"91.Why do we need Cloud?\">91.Why do we need Cloud?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-95\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#92What_are_Resource_Groups\" title=\"92.What are Resource Groups?\">92.What are Resource Groups?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-96\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#93What_are_the_categories_of_services_provided_in_the_Cloud\" title=\"93.What are the categories of services provided in the Cloud?\">93.What are the categories of services provided in the Cloud?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-97\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#94Can_you_name_some_scenarios_where_VMs_are_preferred\" title=\"94.Can you name some scenarios where VMs are preferred?\">94.Can you name some scenarios where VMs are preferred?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-98\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#95What_are_the_types_of_Disk_used_by_VMs\" title=\"95.What are the types of Disk used by VMs?\">95.What are the types of Disk used by VMs?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-99\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#96How_are_Virtual_Hard_Disks_stored_in_Azure_and_what_type_of_storage_is_recommended_for_VHDs\" title=\"96.How are Virtual Hard Disks stored in Azure and what type of storage is recommended for VHDs?\">96.How are Virtual Hard Disks stored in Azure and what type of storage is recommended for VHDs?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-100\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#97Name_some_roles_features_not_supported_in_Azure_VM\" title=\"97.Name some roles &amp; features not supported in Azure VM?\">97.Name some roles &amp; features not supported in Azure VM?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-101\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#98What_Is_The_Difference_Between_Block_Blob_Vs_Page_Blob\" title=\"98.What Is The Difference Between Block Blob Vs Page Blob?\">98.What Is The Difference Between Block Blob Vs Page Blob?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-102\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#99What_are_the_top-level_concepts_of_Azure_Data_Factory\" title=\"99.What are the top-level concepts of Azure Data Factory?\">99.What are the top-level concepts of Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-103\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#100Explain_the_two_levels_of_security_in_ADLS_Gen2\" title=\"100.Explain the two levels of security in ADLS Gen2?\">100.Explain the two levels of security in ADLS Gen2?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-104\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#101How_many_databases_can_we_create_in_a_single_server\" title=\"101.How many databases can we create in a single server\">101.How many databases can we create in a single server<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-105\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#102How_many_servers_can_we_create_in_a_single_subscription\" title=\"102.How many servers can we create in a single subscription?\">102.How many servers can we create in a single subscription?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-106\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#103What_are_the_benefits_of_the_traffic_manager_in_Windows_Azure\" title=\"103.What are the benefits of the traffic manager in Windows Azure?\">103.What are the benefits of the traffic manager in Windows Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-107\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#104Discuss_the_different_database_types_in_SQL_Azure\" title=\"104.Discuss the different database types in SQL Azure?\">104.Discuss the different database types in SQL Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-108\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#105How_is_Azure_Resource_Manager_beneficial_over_the_classic_services\" title=\"105.How is Azure Resource Manager beneficial over the classic services?\">105.How is Azure Resource Manager beneficial over the classic services?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-109\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#106Enlist_the_monitoring_features_that_are_present_in_the_SharePoint_2010\" title=\"106.Enlist the monitoring features that are present in the SharePoint 2010?\">106.Enlist the monitoring features that are present in the SharePoint 2010?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-110\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#107Comparea_the_STS_and_SPS_and_state_its_important_features\" title=\"107.Comparea the STS and SPS and state its important features?\">107.Comparea the STS and SPS and state its important features?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-111\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#108Explain_MOSS\" title=\"108.Explain MOSS?\">108.Explain MOSS?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-112\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#109What_do_you_mean_by_SAS\" title=\"109.What do you mean by SAS?\">109.What do you mean by SAS?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-113\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#110State_some_features_of_SAS\" title=\"110.State some features of SAS?\">110.State some features of SAS?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-114\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#111Describe_the_common_architecture_of_SharePoint_2010\" title=\"111.Describe the common architecture of SharePoint 2010?\">111.Describe the common architecture of SharePoint 2010?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-115\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#112Describe_the_log_analytics\" title=\"112.Describe the log analytics?\">112.Describe the log analytics?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-116\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#113If_the_client_gets_disconnected_from_cache_with_the_services_state_the_probable_cause\" title=\"113.If the client gets disconnected from cache with the services state the probable cause?\">113.If the client gets disconnected from cache with the services state the probable cause?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-117\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#114Explain_how_a_character_analytics_API_functions\" title=\"114.Explain how a character analytics API functions?\">114.Explain how a character analytics API functions?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-118\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#115_What_is_difference_between_IaaS_PaaS_and_SaaS\" title=\"115. What is difference between IaaS, PaaS, and SaaS?\">115. What is difference between IaaS, PaaS, and SaaS?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-119\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#116Why_do_we_need_Azure_Data_Factory\" title=\"116.Why do we need Azure Data Factory?\">116.Why do we need Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-120\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#117What_is_Azure\" title=\"117.What is Azure?\">117.What is Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-121\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#118Is_Azure_data_Factory_an_ETL_tool\" title=\"118.Is Azure data Factory an ETL tool?\">118.Is Azure data Factory an ETL tool?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-122\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#119What_is_the_use_of_Azure_Data_Lake_in_Azure_data_Factory_ADF\" title=\"119.What is the use of Azure Data Lake in Azure data Factory (ADF)?\">119.What is the use of Azure Data Lake in Azure data Factory (ADF)?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-123\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#120What_is_parameterization_in_Azure\" title=\"120.What is parameterization in Azure?\">120.What is parameterization in Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-124\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#121What_is_Global_parameters_in_Azure_Data_Factory\" title=\"121.What is Global parameters in Azure Data Factory?\">121.What is Global parameters in Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-125\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#122What_is_the_use_of_dataset_in_Azure_data_Factory\" title=\"122.What is the use of dataset in Azure data Factory?\">122.What is the use of dataset in Azure data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-126\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#123What_is_Copy_activity_in_Azure_Data_Factory\" title=\"123.What is Copy activity in Azure Data Factory?\">123.What is Copy activity in Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-127\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#124What_are_the_types_of_Integration_Runtimes_in_Azure_Data_Factory\" title=\"124.What are the types of Integration Runtimes in Azure Data Factory?\">124.What are the types of Integration Runtimes in Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-128\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#125How_to_copy_data_from_an_Azure_Blob_Storage_text_file_to_an_Azure_SQL_Database_table\" title=\"125.How to copy data from an Azure Blob Storage (text file) to an Azure SQL Database table?\">125.How to copy data from an Azure Blob Storage (text file) to an Azure SQL Database table?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-129\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#126_Briefly_explain_different_components_of_Azure_Data_Factory\" title=\"126. Briefly explain different components of Azure Data Factory:\">126. Briefly explain different components of Azure Data Factory:<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-130\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#127What_is_the_need_for_Azure_Data_Factory\" title=\"127.What is the need for Azure Data Factory?\">127.What is the need for Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-131\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#128Is_there_any_limit_on_how_many_integration_runtimes_can_be_performed\" title=\"128.Is there any limit on how many integration runtimes can be performed?\">128.Is there any limit on how many integration runtimes can be performed?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-132\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#129Explain_Data_Factory_Integration_Runtime\" title=\"129.Explain Data Factory Integration Runtime?\">129.Explain Data Factory Integration Runtime?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-133\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#130Mention_about_three_types_of_triggers_that_Azure_Data_Factory_supports\" title=\"130.Mention about three types of triggers that Azure Data Factory supports?\">130.Mention about three types of triggers that Azure Data Factory supports?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-134\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#131_What_it_means_by_blob_storage_in_Azure\" title=\"131. What it means by blob storage in Azure?\">131. What it means by blob storage in Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-135\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#132Mentions_the_steps_for_creating_ETL_process_in_Azure_Data_Factory\" title=\"132.Mentions the steps for creating ETL process in Azure Data Factory?\">132.Mentions the steps for creating ETL process in Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-136\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#133Mention_about_three_types_of_triggers_that_Azure_Data_Factory_supports\" title=\"133.Mention about three types of triggers that Azure Data Factory supports?\">133.Mention about three types of triggers that Azure Data Factory supports?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-137\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#134How_to_create_Azure_Functions\" title=\"134.How to create Azure Functions?\">134.How to create Azure Functions?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-138\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#135What_are_the_steps_to_access_data_through_the_use_of_the_other_80_dataset_types_in_Data_Factory\" title=\"135.What are the steps to access data through the use of the other 80 dataset types in Data Factory?\">135.What are the steps to access data through the use of the other 80 dataset types in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-139\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#136What_do_you_need_for_executing_an_SSIS_package_in_Data_Factory\" title=\"136.What do you need for executing an SSIS package in Data Factory?\u00a0\">136.What do you need for executing an SSIS package in Data Factory?\u00a0<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-140\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#137What_are_Datasets_in_ADF\" title=\"137.What are Datasets in ADF?\">137.What are Datasets in ADF?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-141\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#138What_is_the_use_of_the_ADF_Service\" title=\"138.What is the use of the ADF Service?\">138.What is the use of the ADF Service?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-142\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#139How_do_the_Mapping_data_flow_and_Wrangling_data_flow_transformation_activities_differ_in_Data_Factory\" title=\"139.How do the Mapping data flow and Wrangling data flow transformation activities differ in Data Factory?\u00a0\">139.How do the Mapping data flow and Wrangling data flow transformation activities differ in Data Factory?\u00a0<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-143\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#140What_Are_Azure_Databricks\" title=\"140.What Are Azure Databricks?\">140.What Are Azure Databricks?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-144\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#141What_is_Azure_SQL_Data_Warehouse\" title=\"141.What is Azure SQL Data Warehouse?\">141.What is Azure SQL Data Warehouse?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-145\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#142What_is_Azure_Data_Lake\" title=\"142.What is Azure Data Lake?\">142.What is Azure Data Lake?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-146\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#143Explain_data_source_in_the_azure_data_factory\" title=\"143.Explain data source in the azure data factory:\">143.Explain data source in the azure data factory:<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-147\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#144Wahy_is_it_beneficial_to_use_the_Auto_Resolve_Integration_Runtime\" title=\"144.Wahy is it beneficial to use the Auto Resolve Integration Runtime ?\">144.Wahy is it beneficial to use the Auto Resolve Integration Runtime ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-148\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#145How_is_lookup_activity_useful_in_the_azure_data_factory\" title=\"145.How is lookup activity useful in the azure data factory?\">145.How is lookup activity useful in the azure data factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-149\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#146What_are_the_types_of_variables_in_the_azure_data_factory\" title=\"146.What are the types of variables in the azure data factory?\">146.What are the types of variables in the azure data factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-150\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#147Explain_the_linked_service_in_the_azure_data_factory\" title=\"147.Explain the linked service in the azure data factory?\">147.Explain the linked service in the azure data factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-151\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#148What_does_it_mean_by_the_breakpoint_in_the_ADF_pipeline\" title=\"148.What does it mean by the breakpoint in the ADF pipeline?\">148.What does it mean by the breakpoint in the ADF pipeline?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-152\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#149What_is_the_difference_between_the_Dataset_and_Linked_Service_in_Data_Factory\" title=\"149.What is the difference between the Dataset and Linked Service in Data Factory?\">149.What is the difference between the Dataset and Linked Service in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-153\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#150Data_Factory_consists_of_a_number_of_components_Mention_these_components_briefly\" title=\"150.Data Factory consists of a number of components. Mention these components briefly\">150.Data Factory consists of a number of components. Mention these components briefly<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-154\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#151After_installing_the_Self-Hosted_Integration_Runtime_to_the_machine_where_the_SQL_Server_instance_is_hosted_how_could_we_associate_the_SH-IR_created_from_the_Data_Factory_portal\" title=\"151.After installing the Self-Hosted Integration Runtime to the machine where the SQL Server instance is hosted, how could we associate the SH-IR created from the Data Factory portal?\">151.After installing the Self-Hosted Integration Runtime to the machine where the SQL Server instance is hosted, how could we associate the SH-IR created from the Data Factory portal?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-155\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#152What_is_the_difference_between_the_Mapping_data_flow_and_Wrangling_data_flow_transformation_activities_in_Data_Factory\" title=\"152.What is the difference between the Mapping data flow and Wrangling data flow transformation activities in Data Factory?\">152.What is the difference between the Mapping data flow and Wrangling data flow transformation activities in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-156\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#153Data_Factory_supports_two_types_of_compute_environments_to_execute_the_transform_activities_Mention_these_two_types_briefly\" title=\"153.Data Factory supports two types of compute environments to execute the transform activities. Mention these two types briefly\">153.Data Factory supports two types of compute environments to execute the transform activities. Mention these two types briefly<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-157\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#154What_is_Azure_SSIS_Integration_Runtime\" title=\"154.What is Azure SSIS Integration Runtime?\">154.What is Azure SSIS Integration Runtime?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-158\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#155What_is_required_to_execute_an_SSIS_package_in_Data_Factory\" title=\"155.What is required to execute an SSIS package in Data Factory?\">155.What is required to execute an SSIS package in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-159\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#156Which_Data_Factory_activity_is_used_to_run_an_SSIS_package_in_Azure\" title=\"156.Which Data Factory activity is used to run an SSIS package in Azure?\">156.Which Data Factory activity is used to run an SSIS package in Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-160\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#157Data_Factory_supports_three_types_of_triggers_Mention_these_types_briefly\" title=\"157.Data Factory supports three types of triggers. Mention these types briefly\">157.Data Factory supports three types of triggers. Mention these types briefly<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-161\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#158Any_Data_Factory_pipeline_can_be_executed_using_three_methods_Mention_these_methods\" title=\"158.Any Data Factory pipeline can be executed using three methods. Mention these methods\">158.Any Data Factory pipeline can be executed using three methods. Mention these methods<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-162\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#159From_where_we_can_monitor_the_execution_of_a_pipeline_that_is_executed_under_the_Debug_mode\" title=\"159.From where we can monitor the execution of a pipeline that is executed under the Debug mode?\">159.From where we can monitor the execution of a pipeline that is executed under the Debug mode?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-163\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#160What_are_the_advantages_of_Azure_Resource_Manager\" title=\"160.What are the advantages of Azure Resource Manager?\">160.What are the advantages of Azure Resource Manager?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-164\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#161How_has_integrated_hybrid_cloud_been_useful_for_Azure\" title=\"161.How has integrated hybrid cloud been useful for Azure?\">161.How has integrated hybrid cloud been useful for Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-165\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#162hat_kind_of_storage_is_best_suited_to_handle_unstructured_data\" title=\"162.hat kind of storage is best suited to handle unstructured data?\">162.hat kind of storage is best suited to handle unstructured data?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-166\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#163Azure_Data_Factory_Execute_Pipeline_Activity_Example\" title=\"163.Azure Data Factory Execute Pipeline Activity Example\">163.Azure Data Factory Execute Pipeline Activity Example<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-167\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#164Azure_Data_Factory_Lookup_Activity\" title=\"164.Azure Data Factory Lookup Activity?\">164.Azure Data Factory Lookup Activity?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-168\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#165Azure_Data_Factory_Triggers\" title=\"165.Azure Data Factory Triggers?\">165.Azure Data Factory Triggers?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-169\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#166What_are_Data_Flows_in_Azure_Data_Factory\" title=\"166.What are Data Flows in Azure Data Factory?\">166.What are Data Flows in Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-170\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#167Azure_Data_Factory_Pipeline_Scheduling_Error_Handling_and_Monitoring\" title=\"167.Azure Data Factory Pipeline Scheduling, Error Handling and Monitoring ?\">167.Azure Data Factory Pipeline Scheduling, Error Handling and Monitoring ?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-171\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#168Azure_Data_Factory_for_Web_Scraping\" title=\"168.Azure Data Factory for Web Scraping?\">168.Azure Data Factory for Web Scraping?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-172\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#169Transfer_Data_to_the_Cloud_Using_Azure_Data_Factory\" title=\"169.Transfer Data to the Cloud Using Azure Data Factory?\">169.Transfer Data to the Cloud Using Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-173\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#170Data_Factory_Concepts_Mapping_with_SSIS\" title=\"170.Data Factory Concepts Mapping with SSIS?\">170.Data Factory Concepts Mapping with SSIS?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-174\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#171Why_Azure_Data_Factory\" title=\"171.Why Azure Data Factory?\">171.Why Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-175\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#172ETL_process_in_Azure_Data_Factory\" title=\"172.ETL process in Azure Data Factory\">172.ETL process in Azure Data Factory<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-176\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#173Define_default_values_for_the_Pipeline_Parameters\" title=\"173.Define default values for the Pipeline Parameters?\">173.Define default values for the Pipeline Parameters?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-177\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#174Can_an_activity_output_property_be_consumed_in_another_activity\" title=\"174.Can an activity output property be consumed in another activity?\">174.Can an activity output property be consumed in another activity?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-178\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#175Data_Factory_consists_of_a_number_of_components_Mention_these_components_briefly\" title=\"175.Data Factory consists of a number of components. Mention these components briefly\">175.Data Factory consists of a number of components. Mention these components briefly<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-179\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#176What_is_the_difference_between_the_Dataset_and_Linked_Service_in_Data_Factory\" title=\"176.What is the difference between the Dataset and Linked Service in Data Factory?\">176.What is the difference between the Dataset and Linked Service in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-180\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#177What_is_Data_Factory_Integration_Runtime\" title=\"177.What is Data Factory Integration Runtime?\">177.What is Data Factory Integration Runtime?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-181\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#178Data_Factory_supports_three_types_of_Integration_Runtimes_Mention_these_supported_types_with_a_brief_description_for_each\" title=\"178.Data Factory supports three types of Integration Runtimes. Mention these supported types with a brief description for each?\">178.Data Factory supports three types of Integration Runtimes. Mention these supported types with a brief description for each?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-182\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#179What_is_the_difference_between_the_Mapping_data_flow_and_Wrangling_data_flow_transformation_activities_in_Data_Factory\" title=\"179.What is the difference between the Mapping data flow and Wrangling data flow transformation activities in Data Factory?\">179.What is the difference between the Mapping data flow and Wrangling data flow transformation activities in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-183\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#180Data_Factory_supports_two_types_of_compute_environments_to_execute_the_transform_activities_Mention_these_two_types_briefly\" title=\"180.Data Factory supports two types of compute environments to execute the transform activities. Mention these two types briefly?\">180.Data Factory supports two types of compute environments to execute the transform activities. Mention these two types briefly?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-184\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#181What_is_Azure_SSIS_Integration_Runtime\" title=\"181.What is Azure SSIS Integration Runtime?\">181.What is Azure SSIS Integration Runtime?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-185\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#182What_is_required_to_execute_an_SSIS_package_in_Data_Factory\" title=\"182.What is required to execute an SSIS package in Data Factory?\">182.What is required to execute an SSIS package in Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-186\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#183Which_Data_Factory_activities_can_be_used_to_iterate_through_all_files_stored_in_a_specific_storage_account_making_sure_that_the_files_smaller_than_1KB_will_be_deleted_from_the_source_storage_account\" title=\"183.Which Data Factory activities can be used to iterate through all files stored in a specific storage account, making sure that the files smaller than 1KB will be deleted from the source storage account?\">183.Which Data Factory activities can be used to iterate through all files stored in a specific storage account, making sure that the files smaller than 1KB will be deleted from the source storage account?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-187\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#184Data_Factory_supports_three_types_of_triggers_Mention_these_types_briefly\" title=\"184.Data Factory supports three types of triggers. Mention these types briefly\">184.Data Factory supports three types of triggers. Mention these types briefly<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-188\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#185Any_Data_Factory_pipeline_can_be_executed_using_three_methods_Mention_these_methods\" title=\"185.Any Data Factory pipeline can be executed using three methods. Mention these\u00a0 methods\">185.Any Data Factory pipeline can be executed using three methods. Mention these\u00a0 methods<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-189\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#186From_where_we_can_monitor_the_execution_of_a_pipeline_that_is_executed_under_the_Debug_mode\" title=\"186.From where we can monitor the execution of a pipeline that is executed under the Debug mode?\">186.From where we can monitor the execution of a pipeline that is executed under the Debug mode?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-190\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#187Briefly_describe_the_purpose_of_the_ADF_Service\" title=\"187.Briefly describe the purpose of the ADF Service?\">187.Briefly describe the purpose of the ADF Service?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-191\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#188Data_Factory_consists_of_a_number_of_components_Mention_these_components_briefly\" title=\"188.Data Factory consists of a number of components. Mention these components briefly?\">188.Data Factory consists of a number of components. Mention these components briefly?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-192\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#189Briefly_describe_the_purpose_of_the_ADF_Service\" title=\"189.Briefly describe the purpose of the ADF Service?\">189.Briefly describe the purpose of the ADF Service?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-193\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#190Is_Azure_Data_Factory_Certification_worth_doing\" title=\"190.Is Azure Data Factory Certification worth doing?\">190.Is Azure Data Factory Certification worth doing?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-194\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#191Is_Azure_Data_Factory_an_ETL_tool\" title=\"191.Is Azure Data Factory an ETL tool?\">191.Is Azure Data Factory an ETL tool?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-195\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#192Data_transformed_at_scale_with_code-free_pipelines\" title=\"192.Data transformed at scale with code-free pipelines?\">192.Data transformed at scale with code-free pipelines?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-196\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#193Briefly_explain_different_components_of_Azure_Data_Factory\" title=\"193.Briefly explain different components of Azure Data Factory?\">193.Briefly explain different components of Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-197\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#194What_is_the_need_for_Azure_Data_Factory\" title=\"194.What is the need for Azure Data Factory?\">194.What is the need for Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-198\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#195Is_there_any_limit_on_how_many_integration_runtimes_can_be_performed\" title=\"195.Is there any limit on how many integration runtimes can be performed?\">195.Is there any limit on how many integration runtimes can be performed?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-199\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#196Explain_Data_Factory_Integration_Runtime\" title=\"196.Explain Data Factory Integration Runtime?\">196.Explain Data Factory Integration Runtime?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-200\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#197What_it_means_by_blob_storage_in_Azure\" title=\"197.What it means by blob storage in Azure?\">197.What it means by blob storage in Azure?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-201\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#198Mentions_the_steps_for_creating_ETL_process_in_Azure_Data_Factory\" title=\"198.Mentions the steps for creating ETL process in Azure Data Factory?\">198.Mentions the steps for creating ETL process in Azure Data Factory?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-202\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#199How_to_create_Azure_Functions\" title=\"199.How to create Azure Functions?\">199.How to create Azure Functions?<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-203\" href=\"https:\/\/gauthamit.com\/blog\/adf-interview-questions\/#200What_is_Azure_SQL_Data_Warehouse\" title=\"200.What is Azure SQL Data Warehouse?\">200.What is Azure SQL Data Warehouse?<\/a><\/li><\/ul><\/nav><\/div>\n<h2><span class=\"ez-toc-section\" id=\"ADF_Interview_Questions\"><\/span><strong>ADF Interview Questions<\/strong><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<h2><span class=\"ez-toc-section\" id=\"1Why_do_we_need_Azure_Data_Factory\"><\/span>1.Why do we need Azure Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Data factory does not store any data itself; it lets you\u00a0<\/span><b>create workflows<\/b><span style=\"font-weight: 400;\">\u00a0that orchestrate the movement of data between supported data stores and data processing. You can<\/span><b>\u00a0monitor<\/b><span style=\"font-weight: 400;\">\u00a0and\u00a0<\/span><b>manage<\/b><span style=\"font-weight: 400;\">\u00a0your workflows using both\u00a0<\/span><b>programmatic<\/b><span style=\"font-weight: 400;\">\u00a0and<\/span><b>\u00a0UI mechanisms<\/b><span style=\"font-weight: 400;\">.\u00a0Apart from that, it is the best tool available today for ETL processes with an easy-to-use interface. This shows the need for Azure Data Factory.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"2What_is_Azure_Data_Factory\"><\/span>2.What is Azure Data Factory?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Data Factory is a\u00a0<\/span><b>cloud-based integration service<\/b><span style=\"font-weight: 400;\">\u00a0offered by Microsoft that lets you\u00a0<\/span><b>create data-driven workflows<\/b><span style=\"font-weight: 400;\">\u00a0for orchestrating and\u00a0<\/span><b>automating data movement<\/b><span style=\"font-weight: 400;\">\u00a0and data transformation overcloud. Data Factory services also offer to create and running data pipelines that move and transform data and then run the pipeline on a specified schedule.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"3What_is_Integration_Runtime\"><\/span>3.What is Integration Runtime?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Integration runtime is nothing but a\u00a0<\/span><b>compute infrastructure<\/b><span style=\"font-weight: 400;\">\u00a0used by Azure Data Factory to provide integration capabilities across different network environments.<\/span><\/li>\n<\/ul>\n<h3><span class=\"ez-toc-section\" id=\"Types_of_Integration_Runtimes\"><\/span>Types of Integration Runtimes:<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<ul>\n<li><b>Azure Integration Runtime<\/b><span style=\"font-weight: 400;\"> \u2013 It can copy data between cloud data stores and dispatch the activity to a variety of computing services such as SQL Server, Azure HD Insight.<\/span><\/li>\n<li><b>Self Hosted Integration Runtime<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 It is software with essentially the same code as Azure Integration runtime, but it is installed on on-premises systems or virtual machines over virtual networks.<\/span><\/li>\n<li><b>Azure SSIS Integration Runtime<\/b><span style=\"font-weight: 400;\"> \u2013 It helps to execute SSIS packages in a managed environment. So when we lift and shift the SSIS packages to the data factory, we use Azure SSIS Integration Runtime.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"4How_much_is_the_limit_on_the_number_of_integration_runtimes\"><\/span>4.How much is the limit on the number of integration runtimes?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b><\/b><span style=\"font-weight: 400;\">There is<\/span><b>\u00a0no specific limit<\/b><span style=\"font-weight: 400;\">\u00a0on the number of integration runtime instances. But there is a limit on the number of\u00a0<\/span><b>VM cores<\/b><span style=\"font-weight: 400;\"> used by Integration runtime based on per subscription for SSIS package execution.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"5What_is_the_difference_between_Azure_Data_Lake_and_Azure_Data_Warehouse\"><\/span>5.What is the difference between Azure Data Lake and Azure Data Warehouse?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<table>\n<tbody>\n<tr>\n<td><b>Azure Data Lake<\/b><\/td>\n<td><b>Data Warehouse<\/b><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">Data Lake is a capable way of storing any type, size, and shape of data.\u00a0<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Data Warehouse acts as a repository for already filtered data from a specific resource.\u00a0<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It is mainly used by\u00a0<\/span><b>Data Scientists<\/b><span style=\"font-weight: 400;\">.\u00a0<\/span><\/td>\n<td><span style=\"font-weight: 400;\">It is more frequently used by\u00a0<\/span><b>Business Professionals<\/b><span style=\"font-weight: 400;\">.\u00a0<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It is\u00a0<\/span><b>highly accessible<\/b><span style=\"font-weight: 400;\">\u00a0with quicker updates.\u00a0<\/span><\/td>\n<td><span style=\"font-weight: 400;\">It becomes a<\/span><b>\u00a0pretty rigid and costly task<\/b><span style=\"font-weight: 400;\">\u00a0to make changes in Data Warehouse.\u00a0<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It defines the schema after when the data is stored successfully.\u00a0<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Datawarehouse defines the schema before storing the data.\u00a0<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It uses\u00a0<\/span><b>ELT<\/b><span style=\"font-weight: 400;\">\u00a0(Extract, Load and Transform) process.\u00a0<\/span><\/td>\n<td><span style=\"font-weight: 400;\">It uses<\/span><b>\u00a0ETL<\/b><span style=\"font-weight: 400;\">\u00a0(Extract, Transform and Load) process.\u00a0<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It is an ideal platform for doing\u00a0<\/span><b>in-depth analysis.<\/b><\/td>\n<td><span style=\"font-weight: 400;\">It is the best platform for\u00a0<\/span><b>operational users.\u00a0<\/b><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<h2><span class=\"ez-toc-section\" id=\"6What_is_Blob_Storage_in_Azure\"><\/span>6.What is Blob Storage in Azure?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b><br \/>\n<\/b><span style=\"font-weight: 400;\">It helps to\u00a0<\/span><b>store<\/b><span style=\"font-weight: 400;\">\u00a0a large amount of<\/span><b>\u00a0unstructured data<\/b><span style=\"font-weight: 400;\">\u00a0such as text, images or binary data. It can be used to expose data publicly to the world. Blob storage is most commonly used for streaming audios or videos, storing data for backup, and disaster recovery, storing data for analysis etc. You can also create Data Lakes using blob storage to perform analytics.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"7Difference_between_Data_Lake_Storage_and_Blob_Storage\"><\/span>7.Difference between Data Lake Storage and Blob Storage<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<table>\n<tbody>\n<tr>\n<td><b>Data Lake Storage<\/b><\/td>\n<td><b>Blob Storage<\/b><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It is an optimized storage solution for\u00a0<\/span><b>big data analytics workloads<\/b><span style=\"font-weight: 400;\">.\u00a0<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Blob Storage is\u00a0<\/span><b>general-purpose storage<\/b><span style=\"font-weight: 400;\">\u00a0for a wide variety of scenarios. It can also do Big Data Analytics.\u00a0<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It follows a\u00a0<\/span><b>hierarchical file system<\/b><span style=\"font-weight: 400;\">.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">It follows an object store with a\u00a0<\/span><b>flat namespace<\/b><span style=\"font-weight: 400;\">.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">In Data Lake Storage, data is stored as<\/span><b>\u00a0files<\/b><span style=\"font-weight: 400;\">\u00a0inside\u00a0<\/span><b>folders<\/b><span style=\"font-weight: 400;\">.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Blob storage lets you create a\u00a0<\/span><b>storage account<\/b><span style=\"font-weight: 400;\">. Storage account has\u00a0<\/span><b>containers<\/b><span style=\"font-weight: 400;\">\u00a0that store the data.\u00a0<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It can be used to store Batch, interactive, stream analytics,\u00a0 and machine learning data.\u00a0<\/span><\/td>\n<td><span style=\"font-weight: 400;\">We can use it to store text files, binary data, media storage for streaming and general purpose data.\u00a0<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<h2><span class=\"ez-toc-section\" id=\"8What_are_the_steps_to_create_an_ETL_process_in_Azure_Data_Factory\"><\/span>8.What are the steps to create an ETL process in Azure Data Factory<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li><span style=\"font-weight: 400;\">There are <\/span><b>straightforward steps<\/b><span style=\"font-weight: 400;\">\u00a0to create an ETL process.\u00a0<\/span><\/li>\n<li><span style=\"font-weight: 400;\">We need to create a service for a<\/span><b>\u00a0linked data store<\/b><span style=\"font-weight: 400;\">\u00a0which is an\u00a0<\/span><b>SQL Server Database<\/b><span style=\"font-weight: 400;\">.\u00a0<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Let\u2019s assume that we have a car dataset.\u00a0<\/span><span style=\"font-weight: 400;\">For this car\u2019s dataset, we can create a\u00a0<\/span><b>linked service<\/b><span style=\"font-weight: 400;\">\u00a0for the\u00a0<\/span><b>destination data store<\/b><span style=\"font-weight: 400;\">\u00a0that is Azure Data Lake.<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Now create a<\/span><b>\u00a0data set<\/b><span style=\"font-weight: 400;\">\u00a0for Data Saving.<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Create a\u00a0<\/span><b>Pipeline<\/b><span style=\"font-weight: 400;\">\u00a0and\u00a0<\/span><b>Copy Activity<\/b><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li><span style=\"font-weight: 400;\">Finally,\u00a0<\/span><b>schedule a pipeline<\/b><span style=\"font-weight: 400;\">\u00a0by adding a trigger.\u00a0<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"9What_is_the_difference_between_Azure_HDInsight_and_Azure_Data_Lake_Analytics\"><\/span>9.What is the difference between Azure HDInsight and Azure Data Lake Analytics?<b><\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<table>\n<tbody>\n<tr>\n<td><b>Azure HDInsight<\/b><\/td>\n<td><b>Azure Data Lake Analytics<\/b><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It is a\u00a0<\/span><b>Platform as a Service<\/b><span style=\"font-weight: 400;\">.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">It is a<\/span><b>\u00a0Software as a Service<\/b><span style=\"font-weight: 400;\">.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">Processing data in it<\/span><b>\u00a0requires configuring the cluster<\/b><span style=\"font-weight: 400;\">\u00a0with predefined nodes. Further, by using languages like pig or hive, we can process the data.\u00a0<\/span><\/td>\n<td><span style=\"font-weight: 400;\">It is all about\u00a0<\/span><b>passing the queries<\/b><span style=\"font-weight: 400;\">\u00a0written for data processing. Data Lake Analytics further creates compute nodes to process the data set.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">Users can easily configure HDInsight Clusters at their convenience. Users can also use Spark, Kafka, without restrictions.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">It does not give that much flexibility in terms of configuration and customization. But, Azure manages it automatically for its users.\u00a0<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<h2><span class=\"ez-toc-section\" id=\"10What_are_the_top-level_concepts_of_Azure_Data_Factory\"><\/span>10.What are the top-level concepts of Azure Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">There are four basic top-level concepts of Azure Data Factory:<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Pipeline<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 It acts as a carrier where lots of processes take place.\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Activities<\/b><span style=\"font-weight: 400;\">\u00a0\u2013\u00a0 It represents the steps of processes in the pipeline.\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Data Sets<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 It is a data structure that holds our data.\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Linked<\/b><span style=\"font-weight: 400;\">\u00a0<\/span><b>Services<\/b><span style=\"font-weight: 400;\">\u2013 These services store information that is essential while connecting the resources or other services. Let\u2019s say we have an SQL server, so we need a connecting string connected to an external device, and we will mention the source and the destination for it.\u00a0<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"11How_can_we_schedule_a_pipeline\"><\/span>11.How can we schedule a pipeline?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The trigger follows a\u00a0<\/span><b>world clock calendar schedule<\/b><span style=\"font-weight: 400;\">\u00a0that can schedule pipelines periodically or in calendar-based recurrent patterns. We can schedule a pipeline in two ways:<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Schedule Trigger<\/b><\/li>\n<li aria-level=\"1\"><b>Window Trigger<\/b><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"12Can_we_pass_parameters_to_a_pipeline_run\"><\/span>12.Can we pass parameters to a pipeline run?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>Yes definitely<\/b><span style=\"font-weight: 400;\">, we can very easily pass parameters to a pipeline run. Pipeline runs are the\u00a0<\/span><b>first-class<\/b><span style=\"font-weight: 400;\">,\u00a0<\/span><b>top-level concepts<\/b><span style=\"font-weight: 400;\"> in Azure Data Factory. We can define parameters at the pipeline level, and then we can pass the arguments to run a pipeline.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"13How_do_I_access_the_data_using_the_other_80_Dataset_types_in_Data_Factory\"><\/span>13.How do I access the data using the other 80 Dataset types in Data Factory?<b><\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The mapping data flow feature currently allows Azure SQL database, Data Warehouse, Delimited text-files from Azure Blob Storage or Azure Data Lake storage to generation tools natively for source and sink. You can use copy activity to states data from any of the other connectors, and then you can execute the data flow activity to transform data.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"14Explain_the_two_levels_of_security_in_ADLS_Gen2\"><\/span>14.Explain the two levels of security in ADLS Gen2?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li><b>Role-Based Access Control<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 It includes<\/span><b>\u00a0built-in azure rules<\/b><span style=\"font-weight: 400;\">\u00a0such as reader, contributor, owner or customer roles. It is specified for two reasons. The first is, who can manage the service itself, and the second is, to permit the reasons is to permit the users built-in data explorer tools<\/span><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li><b>Access Control List\u00a0<\/b><span style=\"font-weight: 400;\">\u2013 Azure Data Lake Storage specifies precisely which data object users may read or write or execute.\u00a0<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"15What_has_changed_from_private_preview_to_limited_public_preview_regarding_data_flows\"><\/span>15.What has changed from private preview to limited public preview regarding data flows?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">There are a couple of things which have been changed mentioned below:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">You are no longer required to bring your own\u00a0<\/span><b>Azure Databricks Clusters<\/b><span style=\"font-weight: 400;\">.\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Data Factory will<\/span><b>\u00a0manage cluster creation<\/b><span style=\"font-weight: 400;\">\u00a0and tear down process.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">We can still use Data Lake Storage Gen 2 and Blob Storage to store those files. You can use the appropriate linked services. You can also use the appropriate linked services for those of the storage engines.\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Blob data sets and Azure Data Lake storage gen 2 are separated into\u00a0<\/span><b>delimited text<\/b><span style=\"font-weight: 400;\">\u00a0and\u00a0<\/span><b>Apache Parquet datasets<\/b><span style=\"font-weight: 400;\">.\u00a0<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"16What_is_the_difference_between_the_Dataset_and_Linked_Service_in_Data_Factory\"><\/span>16.What is the difference between the Dataset and Linked Service in Data Factory?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li aria-level=\"1\"><b>Dataset:\u00a0<\/b><span style=\"font-weight: 400;\">is a reference to the data store that is described by Linked Service.\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Linked Service:<\/b><span style=\"font-weight: 400;\">\u00a0is nothing but a description of the connection string that is used to connect to the data stores.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"17What_is_the_difference_between_the_mapping_data_flow_and_wrangling_data_flow_transformation\"><\/span>17.What is the difference between the mapping data flow and wrangling data flow transformation?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li aria-level=\"1\"><b>Mapping Data Flow:\u00a0<\/b><span style=\"font-weight: 400;\">It is a visually designed data transformation activity that lets users design a graphical data transformation logic without needing an expert developer.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Wrangling Data Flow:\u00a0<\/b><span style=\"font-weight: 400;\">This is a code-free data preparation activity that integrates with Power Query Online.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"18Data_Factory_supports_two_types_of_compute_environments_to_execute_the_transform_activities_Mention_them_briefly\"><\/span>18.Data Factory supports two types of compute environments to execute the transform activities. Mention them briefly.<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Let\u2019s go through the types:<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>On-demand compute environment<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 It is a fully managed environment offered by ADF. In this compute type, a cluster is created to execute the transform activity and removed automatically when the activity is completed.<\/span><\/li>\n<li aria-level=\"1\"><b>Bring your own environment<\/b><span style=\"font-weight: 400;\"> \u2013 In this environment, you yourself manage the compute environment with the help of ADF.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"19What_is_Azure_SSIS_Integration_Runtime\"><\/span>19.What is Azure SSIS Integration Runtime?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b><b><br \/>\n<\/b><\/b><span style=\"font-weight: 400;\">Azure SSIS Integration is a\u00a0<\/span><b>fully managed cluster<\/b><span style=\"font-weight: 400;\">\u00a0of virtual machines that are hosted in Azure and dedicated to run SSIS packages in the data factory. We can easily scale up the SSIS nodes by configuring the node size or scaled out by configuring the number of nodes on the Virtual Machine\u2019s cluster.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"20What_is_required_to_execute_an_SSIS_package_in_Data_Factory\"><\/span>20.What is required to execute an SSIS package in Data Factory?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">We need to create an SSIS Integration Runtime, and an SSIS Database catalogue hosted in the Azure SQL database or Azure SQL managed instance<\/span><span style=\"font-weight: 400;\">.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"21An_Azure_Data_Factory_Pipeline_can_be_executed_using_three_methods_Mention_these_methods\"><\/span>21.An Azure Data Factory Pipeline can be executed using three methods. Mention these methods.<br \/>\n<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Methods to execute Azure Data Factory Pipeline:<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Debug Mode<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Manual execution using trigger now<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Adding schedule, tumbling window\/event trigger<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"22If_we_need_to_copy_data_from_an_on-premises_SQL_Server_instance_using_a_data_factory_which_integration_runtime_should_be_used\"><\/span>22.If we need to copy data from an on-premises SQL Server instance using a data factory, which integration runtime should be used?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Self-hosted integration runtime should be installed on the\u00a0<\/span><b>on-premises machine<\/b><span style=\"font-weight: 400;\">\u00a0where the SQL Server Instance is hosted<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"23An_Azure_Data_Factory_Pipeline_can_be_executed_using_three_methods_Mention_these_methods\"><\/span>23.An Azure Data Factory Pipeline can be executed using three methods. Mention these methods.<br \/>\n<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Methods to execute Azure Data Factory Pipeline:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Debug Mode<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Manual execution using trigger now<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Adding schedule, tumbling window\/event trigger<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"24What_is_Azure_Table_Storage\"><\/span>24.What is Azure Table Storage?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Table Storage is a service that helps users to<\/span><b>\u00a0store structure data<\/b><span style=\"font-weight: 400;\">\u00a0in the cloud and also provides a Keystore with schemas designed. It is swift and effective for modern-day applications.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"_25Can_we_monitor_and_manage_Azure_Data_Factory_Pipelines\"><\/span>\u00a025.Can we monitor and manage Azure Data Factory Pipelines?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Yes, we can monitor and manage ADF Pipelines using the following steps:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Click on the\u00a0<\/span><b>monitor and manage<\/b><span style=\"font-weight: 400;\">\u00a0on the data factory tab.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Click on the\u00a0<\/span><b>resource manager<\/b><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Here, you will find- pipelines, datasets, and linked services in a tree format.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"26What_are_the_steps_involved_in_the_ETL_process\"><\/span>26.What are the steps involved in the ETL process?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">ETL (Extract, Transform, Load) process follows four main steps:<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Connect and Collect \u2013<\/b><span style=\"font-weight: 400;\">\u00a0helps in moving the data on-premises and cloud source data stores<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Transform \u2013<\/b><span style=\"font-weight: 400;\">\u00a0lets users collect the data by using compute services such as HDInsight Hadoop, Spark etc.\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Publish \u2013<\/b><span style=\"font-weight: 400;\">\u00a0Helps in loading the data into Azure data warehouse, Azure SQL database, and Azure Cosmos DB etc<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Monitor \u2013<\/b><span style=\"font-weight: 400;\">\u00a0It helps support the pipeline monitoring via Azure Monitor, API and PowerShell, Log Analytics, and health panels on the Azure Portal.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"27What_do_we_understand_by_Integration_Runtime\"><\/span>27.What do we understand by Integration Runtime?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Integration runtime is referred to as a\u00a0<\/span><b>compute infrastructure<\/b><span style=\"font-weight: 400;\">\u00a0used by Azure Data Factory. It provides integration capabilities across various network environments.<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>A quick look at the Types of Integration Runtimes:<\/b><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Azure Integration Runtime<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 Can copy data between cloud data stores and send activity to various computing services such as SQL Server, Azure HDInsight, etc.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Self Hosted Integration Runtime<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 It\u2019s basically software with the same code as the Azure Integration Runtime, but it\u2019s installed on your local system or virtual machine over a virtual network.<\/span><\/li>\n<li aria-level=\"1\"><b>Azure SSIS Integration Runtime<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 It allows you to run SSIS packages in a managed environment. So when we lift and shift SSIS packages to the data factory, we use Azure SSIS Integration Runtime.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"28What_is_the_difference_between_Azure_Data_Lake_and_Azure_Data_Warehouse\"><\/span>28.What is the difference between Azure Data Lake and Azure Data Warehouse?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<table>\n<tbody>\n<tr>\n<td><b>Azure Data Lake<\/b><\/td>\n<td><b>Data Warehouse<\/b><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">Data Lakes are capable of storing data of any form, size, or shape.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">A Data Warehouse is a store for data that has previously been filtered from a specific resource.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">Data Scientists are the ones who use it the most.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Business professionals are the ones who use it the most.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It is easily accessible and receives frequent changes.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Changing the Data Warehouse becomes a very strict and costly task.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">When the data is correctly stored, it determines the schema.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">Before storing the data, the data warehouse defines the schema.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It employs the ELT (Extract, Load, and Transform) method.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">It employs the ETL (Extract, Transform, and Load) method.<\/span><\/td>\n<\/tr>\n<tr>\n<td><span style=\"font-weight: 400;\">It\u2019s an excellent tool for conducting in-depth research.<\/span><\/td>\n<td><span style=\"font-weight: 400;\">It is the finest platform for operational users.\u00a0<\/span><\/td>\n<\/tr>\n<\/tbody>\n<\/table>\n<p>&nbsp;<\/p>\n<h2><span class=\"ez-toc-section\" id=\"29Describe_the_process_to_create_an_ETL_process_in_Azure_Data_Factory\"><\/span>29.Describe the process to create an ETL process in Azure Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">You can create an ETL process with a few steps.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Create a service for linked data store i.e. SQL Server Database.\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Let\u2019s consider you have a dataset for vehicles.\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Now for this dataset, you can create a linked service for the destination store i.e. Azure Data Lake.\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Then create a Data Set for Data Saving.\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The next step is to create a pipeline and copy activity. When you are done with creating a pipeline, schedule a pipeline with the use of an added trigger.\u00a0\u00a0<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"30What_are_the_top-level_concepts_of_Azure_Data_Factory\"><\/span>30.What are the top-level concepts of Azure Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">There are four basic top-level Azure Data Factory concepts:<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Pipeline<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 It acts as a transport service where many processes take place.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Activities<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 It represents the stages of processes in the pipeline.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Datasets<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 This is the data structure that holds our data.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Linked Services<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 These services store information needed when connecting other resources or services. Let\u2019s say we have a SQL server, so we need a connection string that is connected to an external device and we will mention its source and destination.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"31How_can_we_schedule_a_pipeline\"><\/span>31.How can we schedule a pipeline?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">We can schedule pipelines using a trigger. It follows a world clock calendar schedule. We can<\/span><\/p>\n<p><span style=\"font-weight: 400;\">schedule pipelines periodically or calendar-based recurrent patterns. Here are the two ways:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">\u00a0\u00a0\u00a0\u00a0Schedule Trigger<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">\u00a0\u00a0\u00a0Window Trigger<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"32Is_there_any_way_to_pass_parameters_to_a_pipeline_run\"><\/span>32.Is there any way to pass parameters to a pipeline run?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Yes absolutely, passing parameters to a pipeline run is a very easy task. Pipelines are known as the first-class, top-level concepts in Azure Data Factory. We can\u00a0<\/span><b>set<\/b><span style=\"font-weight: 400;\">\u00a0parameters at the pipeline\u00a0<\/span><b>level<\/b><span style=\"font-weight: 400;\">\u00a0and then we can pass the arguments to run a pipeline.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"33_What_is_the_difference_between_the_mapping_data_flow_and_wrangling_data_flow_transformation\"><\/span>33. What is the difference between the mapping data flow and wrangling data flow transformation?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li aria-level=\"1\"><b>Mapping Data Flow:<\/b><span style=\"font-weight: 400;\">\u00a0This is a visually designed data conversion activity that allows users to design graphical data conversion logic without the need for experienced developers.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Wrangling Data Flow:<\/b><span style=\"font-weight: 400;\">\u00a0This is a code-free data preparation activity built into Power Query Online.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"34Is_there_any_way_to_pass_parameters_to_a_pipeline_run\"><\/span>34.Is there any way to pass parameters to a pipeline run?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Yes absolutely, passing parameters to a pipeline run is a very easy task. Pipelines are known as the first-class, top-level concepts in Azure Data Factory. We can\u00a0<\/span><b>set<\/b><span style=\"font-weight: 400;\">\u00a0parameters at the pipeline\u00a0<\/span><b>level<\/b><span style=\"font-weight: 400;\"> and then we can pass the arguments to run a pipeline.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"35Explain_the_two_levels_of_security_in_ADLS_Gen2\"><\/span>35.Explain the two levels of security in ADLS Gen2?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li aria-level=\"1\"><b>Role-based Access Control<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 It includes built-in Azure rules such as reader, contributor, owner or customer roles. It is indicated for two reasons. The first is who can manage the service themselves, and the second is to provide users with built-in data mining tools.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Access Control Lists<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 Azure Data Lake Storage specifies exactly which data objects users can read, write, or execute.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"36What_has_changed_from_private_preview_to_limited_public_preview_regarding_data_flows\"><\/span>36.What has changed from private preview to limited public preview regarding data flows?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Some of the things that have changed are mentioned below:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">There is no need to bring your own Azure Data bricks clusters now.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Data Factory will handle cluster creation and deletion.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">We can still use Data Lake Storage Gen 2 and Blob Storage to store these files. You may use the appropriate linked services. You may also use associated services that are appropriate for the services of the storage engines.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Blob dataset and Azure Data Lake gen 2 storage split into delimited text and Apache Parquet dataset.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"37Data_Factory_supports_two_types_of_compute_environments_to_execute_the_transform_activities_What_are_those\"><\/span>37.Data Factory supports two types of compute environments to execute the transform activities. What are those?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Let\u2019s take a look at the types.<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>On-Demand Computing Environment<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 This is a fully managed environment provided by ADF. This type of calculation creates a cluster to perform the transformation activity and automatically deletes it when the activity is complete.\u00a0<\/span><\/li>\n<li aria-level=\"1\"><b>Bring your own environment<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 In this environment, use ADF to manage your computing environment yourself.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"_38Can_an_activity_output_property_be_consumed_in_another_activity\"><\/span>\u00a038.Can an activity output property be consumed in another activity?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Yes. An activity output can be consumed in a subsequent activity with the @activity\u00a0construct<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"39What_is_the_way_to_access_data_by_using_the_other_90_dataset_types_in_Data_Factory\"><\/span>39.What is the way to access data by using the other 90 dataset types in Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">For source and sink, the mapping data flow feature supports Azure SQL Database, Azure Synapse Analytics, delimited text files from Azure Blob storage or Azure Data Lake Storage Gen2, and Parquet files from Blob storage or Data Lake Storage Gen2.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Use the Copy action to stage data from any of the other connectors, then use the Data Flow activity to transform the data once it\u2019s staged. For example, your pipeline might copy data into Blob storage first, then transform it with a Data Flow activity that uses a dataset from the source.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"40Is_it_possible_to_calculate_a_value_for_a_new_column_from_the_existing_column_from_mapping_in_ADF\"><\/span>40.Is it possible to calculate a value for a new column from the existing column from mapping in ADF?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">In the mapping data flow, you can use derive transformation to generate a new column based on the logic you want. You can either create a new derived column or update an existing one when generating a derived column. Enter the name of the column you\u2019re creating in the Column textbox.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The column dropdown can be used to override an existing column in your schema. Click the Enter expression textbox to start creating the derived column\u2019s expression. You have the option of either inputting your expression or using the expression builder to create your logic.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"41What_is_the_way_to_parameterize_column_name_in_dataflow\"><\/span>41.What is the way to parameterize column name in dataflow?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">We can pass parameters to columns similar to other properties. Like in derived column customer can use\u00a0<\/span><b>$ColumnNameParam = toString(by Name($myColumnNameParamInData)).<\/b><span style=\"font-weight: 400;\">\u00a0These parameters can be passed from pipeline execution down to Data flows.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"42In_what_way_we_can_write_attributes_in_cosmos_DB_in_the_same_order_as_specified_in_the_sink_in_ADF_data_flow\"><\/span>42.In what way we can write attributes in cosmos DB in the same order as specified in the sink in ADF data flow?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Because each document in Cosmos DB is stored as a JSON object, which is an unordered set of name\/value pairs, the order cannot be guaranteed.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"43What_are_the_Pipelines_and_Activities_in_Azure_Data_Factory\"><\/span>43.What are the Pipelines and Activities in Azure Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">A data factory consists of one or more pipelines. A\u00a0<\/span><b>Pipeline<\/b><span style=\"font-weight: 400;\">\u00a0is a logical set of activities that together perform some action. For example, A pipeline can have activities which ingest the data into File Share and publish some event once the task is completed. A Pipeline allows you to manage the activities as a set instead of each one. A data factory allows you to deploy and schedule the pipeline instead of each activity individually.<\/span><\/p>\n<p><b>Activity<\/b><span style=\"font-weight: 400;\">\u00a0refers to some actions that you need to perform on data. For example, you can use copy activity to transfer data from Azure Blob Storage to Azure File Share. Data factory groups the activities into three categories as below.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Data movement activities<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Data transformation activities<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Control activities<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"44What_are_Datasets_in_ADF\"><\/span>44.What are Datasets in ADF?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>Dataset<\/b><span style=\"font-weight: 400;\">\u00a0refers to that data that you are going to use in your pipeline activities as inputs and outputs. Dataset represents the structure of data within linked data stores such as files, folders, documents etc. For example, An Azure blob dataset defines the container and folder in blob storage from which a pipeline activity should read data as input to process. For more visit\u00a0<\/span><a href=\"https:\/\/docs.microsoft.com\/en-us\/azure\/data-factory\/concepts-datasets-linked-services\" target=\"_blank\" rel=\"noopener\"><b>Datasets<\/b><\/a><span style=\"font-weight: 400;\">.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"45Explain_Integration_Runtime_in_the_Data_Factory\"><\/span>45.Explain Integration Runtime in the Data Factory?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure data factory uses a compute infrastructure known as\u00a0<\/span><b>Integration Runtime (IR)<\/b><span style=\"font-weight: 400;\">, Which provides data integration capabilities over different network environments. These integration capabilities include:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Data Flow<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Data Movement<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Activity Dispatch<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">SSIS package execution<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"46How_does_ADF_Pipeline_execution_work\"><\/span>46.How does ADF Pipeline execution work?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">A pipeline run can be defined as an instance of a pipeline execution. For example, you have a data factory pipeline to copy data from blob to file share that runs by event grid trigger. Each pipeline run has a unique id known as pipeline run id. This pipeline run id is a GUID that uniquely identifies each pipeline run. You can run a pipeline either by using some trigger or manually. For more<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"47What_are_Triggers_in_a_Data_Factory\"><\/span>47.What are Triggers in a Data Factory?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>Triggers<\/b><span style=\"font-weight: 400;\">\u00a0represent an action or unit of processing which determines when a pipeline execution can be kicked off. Triggers are another way to execute a data factory pipeline. Triggers have many-to-many relationships with pipelines meaning &#8211; a single trigger can kick off multiple pipelines, or multiple triggers can kick off a single pipeline execution. Azure Data factory supports three types of triggers as below.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Schedule trigger<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Tumbling window trigger<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Event-based trigger<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"48What_is_azure_data_factory_used_for\"><\/span>48.What is azure data factory used for ?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Data factory is the data orchestration service provided by the Microsoft Azure cloud. ADF is used for following use cases mainly :<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Data migration from one data source to other<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">On Premise to\u00a0cloud\u00a0 data migration\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">ETL purpose<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Automated the data flow.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">There is huge data laid out there and when you want to move the data from one location to another in automated way within the cloud or from on-premises to the azure cloud azure data factory is the best service we have available.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"49What_is_the_pipeline_in_the_adf\"><\/span>49.What is the pipeline in the adf ?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Pipeline is the set of the activities specified to run in defined sequence. For achieving any task in the azure data factory we create a pipeline which contains the various types of activity as required for fulfilling the business purpose. Every pipeline must have a valid name and optional list of parameters.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"50What_is_the_data_source_in_the_azure_data_factory\"><\/span>50.What is the data source in the azure data factory ?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">It is the source or destination system which contains the data to be used or operate upon. Data could be of any type like text, binary, json, csv type files or may be audio, video, image files, or may be a proper database. Data source examples are : azure blob storage \u00a0, azure data lake storage, any database like azure sgl database \u00a0, mysql db postages , and etc.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">There are 80+ different data source connector provided by the azure data factory to get in\/out data from the data source.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"51What_is_the_integration_runtime_in_Azure_data_factory\"><\/span>51.What is the integration runtime in Azure data factory :<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">It is the powerhouse of the azure data pipeline.\u00a0\u00a0Integration runtime is also knows as IR, is the one who provides the computer resources for the data transfer activities and for dispatching the data transfer activities in azure data factory. Integration runtime is the heart of the azure data factory.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">in Azure data factory \u00a0the pipeline is made up of activities. An activity is represents some action that need to be performed. This action could be a data transfer which acquired some execution or it will be dispatch action. Integration runtime provides the area where this activity can execute.\u00a0\u00a0\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"52What_is_Azure_Integration_Runtime\"><\/span><span style=\"font-weight: 400;\">52.What is Azure Integration Runtime ?<b><br \/>\n<\/b><\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">As the name suggested\u00a0<\/span><b>azure integration runtime<\/b><span style=\"font-weight: 400;\">\u00a0is the runtime which is managed by the azure itself. Azure IR represents the infrastructure which is installed, configured, managed and maintained by the azure itself. Now as the infrastructure is managed by the azure it can\u2019t be used to connect to your on premise data sources. Whenever you create the data factory account and create any linked services you will get one IR by default and this is called<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"AutoResolveIntegrationRuntime\"><\/span>AutoResolveIntegrationRuntime<span style=\"font-weight: 400;\">.<\/span><span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">When you create the azure data factory you mentioned the rigion\u00a0along with it. This region specifies where the meta data of the azure data factory would be saved. This is irrespective of the which data source and from which region you are accessing.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For example if you have created the adf account in the US East and you have data source in US West region, then still it is completely ok and data transfer would be possible.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"53What_are_the_different_types_of_integration_runtime\"><\/span><span style=\"font-weight: 400;\">53.What are the different types of integration runtime ?<br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">There are 3 types of the integration runtime available in the Azure data factory. We can choose based upon our requirement the specific integration runtime best fitted in specific scenario. The three types are :<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Azure IR<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Self-hosted\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Azure-SSIS<\/span><\/li>\n<\/ol>\n<h2><span class=\"ez-toc-section\" id=\"54What_is_use_of_lookup_activity_in_azure_data_factory\"><\/span><span style=\"font-weight: 400;\">54.What is use of lookup activity in azure data factory ?<b><br \/>\n<\/b><\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">lookup activity \u00a0in adf pipeline is generally used for configuration lookup purpose. It has the source dataset. Lookup activity used to pull the data from source dataset and keep it as the output of the activity. Output of the lookup activity generally used further in the pipeline for making some decision, configuration accordingly. lookup activity\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">You can say that lookup activity in adf pipelines is just for fetching the data. How you will use this data will totally depends on your pipeline logic. You can fetch\u00a0<\/span><b>first row only<\/b><span style=\"font-weight: 400;\">\u00a0or you can fetch the entire rows based on your query or dataset.<\/span><\/p>\n<p><b>Example of the lookup activity could be :<\/b><span style=\"font-weight: 400;\">\u00a0Lets assume we want to run a pipeline for incremental data load. We want to have copy activity which will pull the data from source system based on the last fetched date. Now the last fetched date we are saving inside the\u00a0<\/span><b>HighWaterMark.txt<\/b><span style=\"font-weight: 400;\">\u00a0file. Here lookup activity will read the HighWaterMark.txt data and then based on the date copy activity will fetch the data.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"55What_is_the_main_advantage_of_the_Auto_Resolve_Integration_Runtime\"><\/span><span style=\"font-weight: 400;\"><br \/>\n55.What is the main advantage of the Auto Resolve Integration Runtime ?<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Advantage of A<i>utoResolveIntegrationRuntime\u00a0<\/i>is that it will automatically try to run the activities in the same\u00a0region <a href=\"https:\/\/azurelib.com\/azure-availability-zones-and-regions\/\" target=\"_blank\" rel=\"noopener\">\u00a0<\/a>if possible or close to the region of the sink data source. This can improve the performance a lot.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"56What_is_copy_activity_in_azure_data_factory\"><\/span>56.What is copy activity in azure data factory<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Copy activity is one of the most popular and highly used activity in the azure data factory.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">copy activity \u00a0is basically used for ETL purpose or lift and shift where you want to move the data from one data source to the other data source. While you copy the data you can also do the transformation for example you read the data from csv file which contains 10 columns however while writing to your target data source you want to keep only 5 columns. You can transform it and you can send only the required number of columns to the the destination data source.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For creating the copy activity you need to have your source and destination ready. Here destination is called as sink. Copy activity requires:<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Linked service<\/b><\/li>\n<li aria-level=\"1\"><b>Datasets<\/b><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">Assume you already have a linked service and data service created in case not you can please refer these links to create link service and datasets.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"57What_do_you_mean_by_variables_in_the_azure_data_factory\"><\/span>57.What do you mean by variables in the azure data factory ?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Variables is the adf pipeline provide the functionality to temporary hold the values. They are used for similar reason like we do use variables in the programming language. They are available inside the pipeline and there is set inside the pipeline.\u00a0<\/span><b>Set Variable\u00a0<\/b><span style=\"font-weight: 400;\">and\u00a0<\/span><b>append variable\u00a0<\/b><span style=\"font-weight: 400;\">are two type of activities used for the setting or manipulating the variables values. There are two types of the variable :<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">System variable\u00a0<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">User Varibles<\/span><\/li>\n<\/ul>\n<p><b>System variable<\/b><span style=\"font-weight: 400;\">: These are some kind of the fixed variable from the azure pipeline itself. For example pipeline name, pipeline id, trigger name etc. You mostly need this to get the system information which might be needed in your use case.<\/span><\/p>\n<p><b>User variable :<\/b><span style=\"font-weight: 400;\">\u00a0User variable is something which you declared manually based on your logic of the pipeline.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"58What_is_the_linked_service_in_the_azure_data_factory\"><\/span>58.What is the linked service in the azure data factory ?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Linked service in azure data factory are basically the connection mechanism to connect to the external source. It works as the connection string to hold the user authentication information.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For example you want to connect to copy the data from the azure blob storage to azure sql server. In this case you need to build the 2 Linked service. One which is connect to blob storage and other to connect to azure sql database.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Using Azure Portal<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">ARM template way<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"59What_is_the_Dataset_in_the_adf\"><\/span>59.What is the Dataset in the adf ?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">In azure data factory as we create the data pipelines for ETL \/ Shift and load \/ Analytics purpose we need to create the dataset.\u00a0<\/span><a href=\"https:\/\/azurelib.com\/create-dynamic-dataset-in-adf\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">\u00a0<\/span><\/a><span style=\"font-weight: 400;\">Dataset connects to the data source via linked service. It is created based upon the type of the data and data source you want to connect. Dataset resembles the type of the data holds by data source.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For example if we want to pull the csv file from the azure blob storage in the copy activity,<\/span> <span style=\"font-weight: 400;\">the dataset for it. Linked service will be used to make connection to the azure blob storage and dataset would hold the csv type data.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"60Can_we_debug_the_pipeline\"><\/span>60.Can we debug the pipeline ?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Debugging is one of the key feature for any developer. To solve and test issue in the code developers uses the debug feature in general. Azure data factory also provide the debugging feature. In this tutorial I will take you through each and every minute details which would help you to\u00a0<\/span><a href=\"https:\/\/azurelib.com\/debug-azure-data-factory-pipeline\/\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">understand the debug azure data factory pipeline<\/span><\/a><span style=\"font-weight: 400;\">\u00a0feature and how you can utilize the same in your day to day work<\/span><\/p>\n<p><span style=\"font-weight: 400;\">When you go to the data pipeline tab there on the top you can see the \u2018Debug\u2019 link to click. Like this :<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"61What_are_the_steps_invovled_in_ETL_process\"><\/span>61.What are the steps invovled in ETL process?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">ETL process generally involves four steps:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Connect &amp; Collect &#8211; Helps in moving the data from on-premises and cloud source data stores.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Transform &#8211; Helps in collecting the data by using compute services such as HDInsight Hadoop, Spark, etc.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Publish &#8211; Helps in loading the data into Azure Data Warehouse, Azure SQL Database, and Azure Cosmos DB, etc.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Monitor &#8211; Helps in supporting the pipeline monitoring via Azure Monitor, API, PowerShell, Log Analytics, and health panels on the Azure portal.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"62What_is_Cloud_Computing\"><\/span>62.What is Cloud Computing?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Cloud computing allows all businesses and individuals for comsuming computing resources such as virtual machines, databases, processing, memory, services, storage, or event number of calls or events and pay-as-you-go . It is culmination of numerous attempts at a large scale computing with seamless access.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Cloud Computing is scalable and reliable as there is no limit on the number of users of resources . As it increases processing and resources.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"63What_are_the_advantages_of_Cloud_Computing\"><\/span>63.What are the advantages of Cloud Computing?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">. \u00a0 \u00a0 Scalability<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">. \u00a0 \u00a0 Agility<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">. \u00a0 \u00a0 High Availability<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">.\u00a0 \u00a0 \u00a0Latency<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">.\u00a0 \u00a0 \u00a0Moving from Capex to Opex<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">.\u00a0 \u00a0 \u00a0Fault Tolerance<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"64Can_we_Monitor_and_manage_Azure_Data_Factory_pipelines\"><\/span>64.Can we Monitor and manage Azure Data Factory pipelines?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Here are the steps to follow:<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">We need to click on Monitor &amp; Manage on the Data Factory tab.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">Secondly we have to click on Resource Explorer.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">We will find &#8211; pipelines, datasets, linked services in a tree format<\/span><span style=\"font-weight: 400;\">.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"65What_is_Azure_Table_Storage\"><\/span>65.What is Azure Table Storage?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Table Storage is a service used across many projects which helps us to store structured data in the cloud and also provides a key store with a schemaless design.It is fast and cost effective for many applications.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">Table storage can store flexible datasets like user data for a web application or any other device information or any other types of metadata which your service requires.We can store any number of entities in the table.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">It helps to store TBs of structured data.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">For storing datasets that don\u2019t require complex joins, foreign keys, or stored procedures.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Quickly querying data using a clustered index.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"66What_are_Azure_Storage_Types\"><\/span>66.What are Azure Storage Types?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Blobs<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Tables<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Files<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Queues<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"67Difference_between_mapping_and_wrangling_data_flows\"><\/span>67.Difference between mapping and wrangling data flows?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b><span style=\"font-weight: 400;\"><br \/>\n<\/span>Mapping<span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">It provides ways to transform data at scale without coding.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">Data flow is great.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">Helps in transforming data with both known and unknown schemas in the sinks and sources.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span>Wrangling<span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">It allows us to do agile data preparation using Power Query Online mashup editor at scale via spark execution.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">Data flow is less formal.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">Helps in model based analytics scenarios.<\/span><br \/>\n<\/b><\/p>\n<h2><span class=\"ez-toc-section\" id=\"68Limit_on_the_number_of_integration_runtimes\"><\/span>68.Limit on the number of integration runtimes?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">An Azure subscription can have one or more Azure Data Factory instances<\/span><span style=\"font-weight: 400;\">.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"69What_is_Azure_Active_Directory_and_what_is_its_purpose\"><\/span>69.What is Azure Active Directory and what is its purpose?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Active directory is a comprehensive identity and access management Cloud solution; it combines directory services, advanced identity governance, application access management and a rich standards-based platform for you.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">As you know, Windows Azure Active Directory is a multi-tenant Service, that provides an enterprise level identity and access management for the Cloud, built to support global scale, reliability and availability.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Some points are as For Azure Active Directory, you must have a Microsoft Account.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Afterwards, I will create a new Windows Azure Active Directory.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Subsequently, I\u2019ll add the users to the directory as either a user or a global admin.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The next step will be optionally enabling multi-factor authentication for the user.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Afterwards, I\u2019ll optionally add the user as a co-administrator for the subscription.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">\u00a0follows about Windows Azure Active Directory, which are:<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"70What_is_Azure_Redis_Cache_and_how_to_implement_it\"><\/span>70.What is Azure Redis Cache and how to implement it?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Redis Cache is a managed version of the popular open source version of Redis Cache which makes it easy for you to add Redis into your applications that are running in Azure. Redis is an in-memory database where data is stored as a key-value pair so the keys can contain data structures like strings, hashes, and lists. You can cache information in Redis and can easily read it out because it is easier to work with memory than it is to go from the disk and talk to a SQL Server.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Suppose, we have a web server where your web application is running. The back-end has SQL Server implementation where the SQL Server is running on a VM or maybe it is an Azure SQL database.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">A user comes to your application and they go to a page that has tons of products on it.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Now, that page has to go to the database to retrieve the information and then that gets sent back to the web server and gets delivered to the user. But if you have thousands of users hitting that web page and you are constantly hitting the database server, it gets very inefficient.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The solution to this is to add Azure Redis Cache and we can cache all of those read operations that are taking place. So, that goes to an in-memory database on the Azure Redis Cache.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">When other users come back and look for the same information on the web app, it gets retrieved right out of the Azure Redis Cache very quickly and hence we take the pressure of the back-end database server.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">While deploying Azure Redis Cache, we can deploy it with a single node, we can deploy it in a different pricing tier with a two node implementation and we can also build an entire cluster with multiple nodes.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Learn more about Azure Redis Cache here: Introduction to Azure Redis Cache.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"71How_to_create_and_connect_to_Azure_SQL_Database\"><\/span>71.How to create and connect to Azure SQL Database?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">First, we need to log into the Azure Portal with our Azure credentials. Then we need to create an Azure SQL database in the Azure portal.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Click on \u201cCreate a resource\u201d on the left side menu and it will open an \u201cAzure Marketplace\u201d. There, we can see the list of services. Click \u201cDatabases\u201d then click on the \u201cSQL Database\u201d.<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Create a SQL database<\/b><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">After clicking the \u201cSQL Database\u201d, it will open another section. There, we need to provide the basic information about our database like Database name, Storage Space, Server name, etc.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"72What_is_Azure_SQL_Data_Warehouse\"><\/span>72.What is Azure SQL Data Warehouse?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The definition given by the dictionary is \u201ca large store of data accumulated from a wide range of sources within a company and used to guide management decisions\u201d. As per the definition, these warehouses allow collecting the data from the various databases located as remote or distributed systems. It can be built by the integration of the data from the multiple sources that can be used for analytical reporting, decision making etc. SQL Data Warehouse is a cloud-based Enterprise application that allows us to work under parallel processing to quickly analyze a complex query from the huge volume of data. It is also a solution for the Big-Data concepts.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"73Can_you_create_a_Virtual_Machine_in_Azure\"><\/span>73.Can you create a Virtual Machine in Azure?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">In this article, we will explore what a Virtual Machine is, along with the step by step implementation and the ways of connecting VMs to our local system.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Virtual Machines Service in Azure provides a highly flexible \u201ccompute on demand\u201d option for running our application workloads. The Azure portal provides a large collection of templates from which we can get started with our desired server and operating system. We can create multiple virtual machines and group them together in Azure cloud services. Cloud services serve as a network and security boundary for virtual machines. By placing virtual machines in cloud service, we can create multiple instances of any tier of our application. For example, we host our web application on three virtual machines having the same server operating system and place those virtual machines in an availability set so that at least one virtual machine will be available at all the times. Virtual machines use the Hyper-V virtual hard disk format (.vhd) for their hard drives. We can simply upload the fixed-size virtual hard disk files from our infrastructure to Azure and also download the hard disk files from Azure to our data center.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"74What_is_CosmosDB\"><\/span>74.What is CosmosDB?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b><br \/>\n<\/b><span style=\"font-weight: 400;\">Azure Cosmos DB is globally replicated, multimodal database service that offers rich querying over schema-free data.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The definition of Cosmos DB says \u2018Globally Replicated\u2019 which means, you can replicate your database in different geographical areas. It stores data in JSON format and there is no need to define the schema in advance hence it is schema free. You can execute the SQL query on stored JSON documents. Cosmos DB was formerly known as Document DB and it supports multimodal like SQL, Table API, Graph API etc.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Azure Cosmos DB is the right solution for web, mobile, gaming applications when predictable throughput, high availability and low latency are key requirements. We will cover throughput, availability, latency in detail in upcoming articles.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Here is a complete series on Cosmos DB: Introduction to Azure Cosmos DB<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"75What_is_Blob\"><\/span>75.What is Blob?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Blob is a service for storing large amounts of unstructured data that can be accessed from anywhere in the world via HTTP or HTTPS.\u201d Blob stands for \u201d Binary Large Object \u201c. It\u2019s designed to store large amounts of unstructured text or binary data like virtual hard disks, videos, images or even log files.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The data can be exposed to the public or stored privately. It scales up or down as your needs change. We no longer manage it, we only pay for what we use.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"76Why_do_we_use_Blob\"><\/span>76.Why do we use Blob?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Store any type of unstructured data that includes images, videos, audio, documents and backups at exabyte scale. It handles trillions of stored objects, with millions of average requests per second, for customers around the world.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Blob has Strong Consistency. When an object is changed, it is verified everywhere for superior data integrity, ensuring you always have access to the latest version.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">We can have the flexibility to perform the edits in storage, which can improve your application performance and reduce bandwidth consumption.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">We have many different types of blobs for our flexibility. Automatically we configure geo-replication options in a single menu, to easily empower global and local access.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">One infrastructure but access world wide. With regions around the world, it is ideal for streaming and storing media, whether it is live broadcast events or long-term archive of petabytes of movies and television shows. We can perform secure backup and disaster recovery<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"77What_Is_Azure_Databricks\"><\/span>77.What Is Azure Databricks?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Databricks is a fast, easy and collaborative Apache\u00ae Spark\u2122 based analytics platform optimized for Azure. Designed in collaboration with the founders of Apache Spark, Azure Databricks combines the best of Databricks and Azure to help customers accelerate innovation with one-click setup; streamlined workflows and an interactive workspace that enables collaboration between data scientists, data engineers, and business analysts.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">As an Azure service, customers automatically benefit from native integration with other Azure services such as Power BI, SQL Data Warehouse, Cosmos DB as well as from enterprise-grade Azure security, including Active Directory integration, compliance, and enterprise-grade SLAs.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Learn more here: What is Azure Databricks.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"78What_is_Azure_Advisor\"><\/span>78.What is Azure Advisor?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The Azure Advisor service provides information about your entire Azure landscape. It gives you a complete overview of your system needs including possible ways to save money.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">High Availability shows you ways to improve the continuity of your business-critical applications.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Security detects threats and vulnerabilities that might lead to security breaches.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Performance shows you ways to speed up your applications.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Cost gives you ways to reduce your overall Azure spreading.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"79What_are_Azure_App_Services\"><\/span>79.What are Azure App Services?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">We can develop an application in any language or framework, such as .NET, .NET Core, Java, Ruby, Node.js, PHP, or Python. Applications run and scale as per our need with complex architecture on both Windows and Linux-based environments. The App service has added the power of Azure to our application, such as security, load balancing, scaling, and automated management. We can also develop capabilities such as continuous deployment from GitHub, Docker Hub, <a href=\"https:\/\/gauthamit.com\/blog\/azure-devops-interview-questions\/\">Azure DevOps<\/a>, and other sources, staging environments, SSL certificates, etc.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Azure App Service enables us to create web, mobile, logic and API apps very easily. We can run any number of these apps within a single Azure App service deployment. Our apps are automatically managed by Azure App Service and run in managed VMs isolated from other customers. We can also use built-in auto-scaling feature supported within Azure App Service that automatically increase and decrease the number of VMs based on consumption resources.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"80What_Is_Azure_Kubernetes_Service\"><\/span>80.What Is Azure Kubernetes Service?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Kubernetes is an open source system started by Google to help orchestrate (deploy, scale and manage) containerized applications. Azure Kubernetes Service makes working with Kubernetes easier.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Before we learn how to orchestrate containers, let\u2019s discuss a bit about containers.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">You can run your applications as containers. Think about containers as isolated processes that have their own directory, user groups, ports, etc. which run in the host machine. They are like virtual machines, but not the same. Virtual machines have their own operating systems, whereas containers use the operating system of the host machine. Also, the containers run from images. Think of images as software installers. But images bundle up the software code with its dependencies, because of which containers run the same way on different environments since they are environment independent to a much larger extent.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"81I_have_some_private_servers_on_my_premises_also_I_have_distributed_some_of_my_workload_on_the_public_cloud_what_is_this_architecture_called\"><\/span>81.I have some private servers on my premises, also I have distributed some of my workload on the public cloud, what is this architecture called?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Virtual Private Network<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Private Cloud<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Virtual Private Cloud<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Hybrid Cloud<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\"> Hybrid Cloud <\/span><b>Explanation:<\/b><span style=\"font-weight: 400;\">This type of architecture would be a hybrid cloud. Why? Because we are using both, the public cloud, and on premises servers I . e the private cloud. To make this hybrid architecture easy to use, wouldn\u2019t it be better if your private and public cloud were all on the same network (virtually). This is established by including your public cloud servers in a virtual private cloud, and connecting virtual cloud with your on premise servers using a VPN (Virtual Private Network).<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"82What_is_Microsoft_Azure_and_why_is_it_used\"><\/span>82.What is Microsoft Azure and why is it used?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">As discussed above, the companies which provide the cloud service are called the Cloud Providers. There are a lot of cloud providers out there, out of them one is Microsoft Azure. It is used for accessing Microsoft\u2019s infrastructure for cloud.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"83Which_service_in_Azure_is_used_to_manage_resources_in_Azure\"><\/span>83.Which service in Azure is used to manage resources in Azure?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Application Insights<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Azure Resource Manager<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Azure Portal<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Log Analytics<\/span><\/li>\n<\/ol>\n<p><span style=\"font-weight: 400;\">Azure Resource Manager<\/span><\/p>\n<p><b>Explanation:<\/b><span style=\"font-weight: 400;\">\u00a0Azure Resource Manager is used to \u201cmanage\u201d infrastructures which involve a no. of azure services. It can be used to deploy, manage and delete all the resources together using a simple JSON script<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"84_What_are_Roles_and_why_do_we_use_them\"><\/span>84. What are Roles and why do we use them?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Roles are nothing servers in layman terms. These servers are managed, load balanced, Platform as a Service virtual machines that work together to achieve a common goal.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">There are 3 types of roles in Microsoft Azure:<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Web Role<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Worker Role<\/span><\/p>\n<p><span style=\"font-weight: 400;\">VM\u00a0 Role<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Let\u2019s discuss each of these roles in detail:<\/span><\/p>\n<p><b>Web Role<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 A web role is basically used to deploy a website, using languages supported by the IIS platform like, PHP, .NET etc. It is configured and customized to run web applications.<\/span><\/p>\n<p><b>Worker Role<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 A worker role is more like an help to the Web role, it used to execute background processes unlike the Web Role which is used to deploy the website.<\/span><\/p>\n<p><b>VM Role<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 The VM role is used by a user to schedule tasks and other windows services. This role can be used to customize the machines on which the web and worker role is running.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"85_Is_it_possible_to_create_a_Virtual_Machine_using_Azure_Resource_Manager_in_a_Virtual_Network_that_was_created_using_classic_deployment\"><\/span>85. Is it possible to create a Virtual Machine using Azure Resource Manager in a Virtual Network that was created using classic deployment?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">This is not supported. You cannot use Azure Resource Manager to deploy a virtual machine into a virtual network that was created using classic deployment.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"86_Are_data_disks_supported_within_scale_sets\"><\/span>86. Are data disks supported within scale sets?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Yes. A scale set can define an attached data disk configuration that applies to all VMs in the set. Other options for storing data include:<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Azure files (SMB shared drives)<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">OS drive<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Temp drive (local, not backed by Azure Storage)<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Azure data service (for example, Azure tables, Azure blobs)<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">External data service (for example, remote database)<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"87_What_is_an_Availability_Set\"><\/span>87 .What is an Availability Set?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">An availability set is a logical grouping of VMs that allows Azure to understand how your application is built to provide redundancy and availability. It is recommended that two or more VMs are created within an availability set to provide for a highly available application and to meet the 99.95% Azure SLA. When a single VM is used with Azure Premium Storage, the Azure SLA applies for unplanned maintenance events.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"88What_are_Fault_Domains\"><\/span>88.What are Fault Domains?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">A fault domain is a logical group of underlying hardware that share a common power source and network switch, similar to a rack within an on-premise data-centers. As you create VMs within an availability set, the Azure platform automatically distributes your VMs across these fault domains. This approach limits the impact of potential physical hardware failures, network outages, or power interruptions.<\/span><\/p>\n<h3><span class=\"ez-toc-section\" id=\"89What_are_Update_Domains\"><\/span>89.What are Update Domains?<span class=\"ez-toc-section-end\"><\/span><\/h3>\n<p><span style=\"font-weight: 400;\">An update domain is a logical group of underlying hardware that can undergo maintenance or can be rebooted at the same time. As you create VMs within an availability set, the Azure platform automatically distributes your VMs across these update domains. This approach ensures that at least one instance of your application always remains running as the Azure platform undergoes periodic maintenance. The order of update domains being rebooted may not proceed sequentially during planned maintenance, but only one update domain is rebooted at a time.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"90What_is_a_cloud_environment\"><\/span>90.What is a cloud environment?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Cloud environment is a model for enabling convenient, on-demand network access to a shared pool of configurable computing resources (e.g., networks, servers, storage, applications, and services) that can be rapidly provisioned and provided with least management effort or provider interaction. This cloud model promotes availability.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"91Why_do_we_need_Cloud\"><\/span>91.Why do we need Cloud?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>On-demand<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 Resources should be always available when you need them, and you have control over turning them on or off to ensure there\u2019s no lack of resource or wastage..<\/span><\/p>\n<p><b>Scalable<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 You ought to be able to scale (increase or decrease the resource) once necessary. The cloud providers should have enough capacity to meet customer\u2019s needs.<\/span><\/p>\n<p><b>Multi-tenant<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 generally you\u2019ll be sharing a similar resource (e.g.hardware) with another tenant.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">But after all, this is often clear to the client. Cloud suppliers shall accountable the safety side, guaranteeing that one tenant won\u2019t be able to access another\u2019s knowledge.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Self-service computation and storage resource \u2013 connected processes including: asking, resource provisioning, and deployment should be self-service and automated, involving much less manual processing. If a machine wherever our service is hosted fails, the cloud supplier ought to be able to failover our service right away.<\/span><\/p>\n<p><b>Reliability<\/b><span style=\"font-weight: 400;\">\u00a0\u2013 Cloud supplier ought to be able to give client responsibility service, committing to uptimes of their service .Utility-based subscription \u2013 you may pay the cloud supplier as a utility-based subscription, rather like paying your electricity bill \u2013 with none direct investment.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"92What_are_Resource_Groups\"><\/span>92.What are Resource Groups?<b><\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">A resource cluster contains the resources needed to with success deploy a VM in Azure.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">It is an instrumentality that holds connected resources for associate degree Azure answers.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In Azure, you logically cluster connected resources like storage accounts, virtual networks, and virtual machines (VMs) to deploy, manage, and maintain them as one entity.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"93What_are_the_categories_of_services_provided_in_the_Cloud\"><\/span>93.What are the categories of services provided in the Cloud?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>IAAS \u2013 Infrastructure as a Service<\/b><\/p>\n<p><span style=\"font-weight: 400;\">IaaS offers you a server within the cloud (virtual machine) that you simply have complete management over.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">With Associate in Nursing Azure VM, you\u2019re to blame for managing everything from the software package on up to the appliance you\u2019re running.<\/span><\/p>\n<p><b>PAAS \u2013 Platform as a Service<\/b><\/p>\n<p><span style=\"font-weight: 400;\">An Azure Cloud Service consists of 2 components: your application files (source code, DLLs, etc.) and a configuration file.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Together, these 2 parts can spin up a mix of net Roles and employee Roles to execute your application.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">With Cloud Services, Azure handles all of the tedious software package details for you, therefore you\u2019ll be able to specialise in what matters \u2013 building a top-quality application for your users.<\/span><\/p>\n<p><b>SAAS \u2013 Software as a Service<\/b><\/p>\n<p><span style=\"font-weight: 400;\">Software as a Service applications are built and hosted through 3rd party vendors who typically charge for a certain level of service \u2013 $30\/month for X projects and Y users.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"94Can_you_name_some_scenarios_where_VMs_are_preferred\"><\/span>94.Can you name some scenarios where VMs are preferred?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Development And check \u2013 Azure VMs provide a fast and straightforward thanks to produce a laptop with specific configurations needed to code and check an application.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Applications within the cloud \u2013 as a result of demand for your application will fluctuate, it would create economic sense to run it on a VM in Azure. You get hold of further VMs after you would like them and shut them down after you don\u2019t.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Extended datacenter \u2013 Virtual machines in AN Azure virtual network will simply be connected to your organization\u2019s network.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">With Unmanaged disks, you create your own storage account and specify that storage account when you create the disk.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"95What_are_the_types_of_Disk_used_by_VMs\"><\/span>95.What are the types of Disk used by VMs?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Operating system disk<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Temporary disk<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Data disk<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"96How_are_Virtual_Hard_Disks_stored_in_Azure_and_what_type_of_storage_is_recommended_for_VHDs\"><\/span>96.How are Virtual Hard Disks stored in Azure and what type of storage is recommended for VHDs?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The VHDs used in Azure are .vhd files stored as page blobs in a standard or premium storage account in Azure.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Standard HDD disks<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Standard SSD disks<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Premium SSD disks<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Ultra Premium disks<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"97Name_some_roles_features_not_supported_in_Azure_VM\"><\/span>97.Name some roles &amp; features not supported in Azure VM?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Dynamic Host Configuration Protocol Server<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Hyper-V (Hyper-V role is supported in Azure Ev3, and Dv3 series VMs only)<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">BitLocker Drive Encryption (on the operating system hard disk, may be used on data disks)<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Network Load Balancing<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Wireless LAN Service<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"98What_Is_The_Difference_Between_Block_Blob_Vs_Page_Blob\"><\/span>98.What Is The Difference Between Block Blob Vs Page Blob?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Block blobs are blocks, each of which is identified by a block ID.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">You create or modify a block blob by uploading a set of blocks and committing them by their block IDs.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">If you are uploading a block blob that is no more than 64 MB in size, you can also upload it in its entirety with a single Put Blob operation. -Each block can be a maximum of 4 MB in size. The maximum size for a block blob in version 2009-09-19 is 200 GB, or up to 50,000 blocks.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Page blobs are a collection of pages. A page is a range of data that is identified by its offset from the start of the blob. To create a page blob, you initialize the page blob by calling Put Blob and specifying its maximum size.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The maximum size for a page blob is 1 TB. A page written to a page blob may be up to 1 TB in size.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"99What_are_the_top-level_concepts_of_Azure_Data_Factory\"><\/span>99.What are the top-level concepts of Azure Data Factory?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li aria-level=\"1\"><b>Pipeline:\u00a0<\/b><span style=\"font-weight: 400;\">It acts as a carrier in which we have various processes taking place.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">This individual process is an activity.<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Activities:\u00a0<\/b><span style=\"font-weight: 400;\">Activities represent the processing steps in a pipeline. A pipeline can have one or multiple activities. It can be anything I . e process like querying a data set or moving the dataset from one source to another.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Datasets:\u00a0<\/b><span style=\"font-weight: 400;\">Sources of data. In simple words, it is a data structure that holds our data.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Linked services<\/b><span style=\"font-weight: 400;\">: These store information that is very important when it comes to connecting an external source.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"100Explain_the_two_levels_of_security_in_ADLS_Gen2\"><\/span>100.Explain the two levels of security in ADLS Gen2?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The two levels of security applicable to ADLS Gen2 were also in effect for ADLS Gen1. Even though this is not new, it is worth calling out the two levels of security because it\u2019s a very fundamental piece to getting started with the data lake and it is confusing for many people just getting started.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Role-Based Access Control (RBAC). RBAC includes built-in Azure roles such as reader, contributor, owner or custom roles. Typically, RBAC is assigned for two reasons. One is to specify who can manage the service itself (i.e., update settings and properties for the storage account). Another reason is to permit the use of built-in data explorer tools, which require reader permissions.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Access Control Lists (ACLs). Access control lists specify exactly which data objects a user may read, write, or execute (execute is required to browse the directory structure). ACLs are POSIX-compliant, thus familiar to those with a Unix or Linux background.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"101How_many_databases_can_we_create_in_a_single_server\"><\/span>101.How many databases can we create in a single server<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">150 databases (including master database) can be created in a single SQL Azure server.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"102How_many_servers_can_we_create_in_a_single_subscription\"><\/span>102.How many servers can we create in a single subscription?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">We can create<\/span><b>\u00a0six(6) servers<\/b><span style=\"font-weight: 400;\">\u00a0under a single subscription.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"103What_are_the_benefits_of_the_traffic_manager_in_Windows_Azure\"><\/span>103.What are the benefits of the traffic manager in Windows Azure?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Traffic manager is allocated to control the distribution of the user to deploy the cloud service. The benefit of the traffic manager constitutes;<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">It makes the application available worldwide through automated traffic control machinery.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The traffic managing service contributes to high performance by loading the page faster and convenient usage.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">There is no lag of time to maintain or upgrade the existing system. The system keeps running in the back while the system takes time for up gradation.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The configuration is made easy through the Azure portal.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"104Discuss_the_different_database_types_in_SQL_Azure\"><\/span>104.Discuss the different database types in SQL Azure?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">This is one of the commonly asked<\/span><b>\u00a0<\/b><span style=\"font-weight: 400;\">SQL Azure interview questions that must be answered by stating that there are two major type of database in SQL Azure;<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Web Edition \u2013<\/b><span style=\"font-weight: 400;\">\u00a0It is having a limit of 5GB SQL that is related to the relational database. The basic advantage is that they can be self-maintained, tolerant to a fault and highly available.<\/span><\/li>\n<li aria-level=\"1\"><b>Business-based Edition \u2013<\/b><span style=\"font-weight: 400;\">\u00a0they support 50GB of T-SQL that is self-managed, tolerant to a fault and highly available. They are suited for the custom web applications or ISV application.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"105How_is_Azure_Resource_Manager_beneficial_over_the_classic_services\"><\/span>105.How is Azure Resource Manager beneficial over the classic services?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The benefits of the Azure Resource Manager that overshadows the benefit of the classic services are;<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The resources need not be managed, deployed or monitored one at a time. They are chain deployment activities throughout the lifecycle without the need for individual data handling.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The data is also deployed at a consistent pace with the ARM service. It enables the user to use a declarative template that indicates the deployment.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Since the role-based control is present in the management platform that provides you with the access to the resources that leads you to control.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">You can mark dependencies between the resources that enable you to get the correct order of deployment.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The resources may be tagged and organized logically so that it is convenient to follow up the billing of your company.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"106Enlist_the_monitoring_features_that_are_present_in_the_SharePoint_2010\"><\/span>106.Enlist the monitoring features that are present in the SharePoint 2010?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">This is one of the SQL Azure interview questions that should be answered by stating that the SharePoint 2010 is a diagnostic logging that takes into the data that are a direct indication of the state of the system. Sometimes it also specifies some timer tasks that are performed to monitor the collected information. The features include;<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">It collects the data on event log, timer service, and performance counter.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">They are involved with data that are search usage.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">They provide matrices that are yielding a collection of sites.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"107Comparea_the_STS_and_SPS_and_state_its_important_features\"><\/span>107.Comparea the STS and SPS and state its important features?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>SPS<\/b><span style=\"font-weight: 400;\">\u00a0is the SharePoint Portal Service which manages the documents and has a search engine more efficient in penetrating the multiple sources of content.<\/span><\/p>\n<p><b>STS<\/b><span style=\"font-weight: 400;\">\u00a0stands for SharePoint team management. As the name suggests they are better for document management for a large organization and have a moderate search engine.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"108Explain_MOSS\"><\/span>108.Explain MOSS?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The answer to this SQL Microsoft Azure interview question for experienced will be MOSS is abbreviated for Microsoft Office SharePoint Server that constitutes a complete version of the portal platform that yields the user to manage, share and even create the document.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"109What_do_you_mean_by_SAS\"><\/span>109.What do you mean by SAS?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">This is one of the common SQL Azure interview questions that should be answered by stating that SAS is an abbreviation for Statistical analytical System which is a software suite performing analysis of multiple variables. It is linked to predictive analysis, data handling, advanced analytics or corporate intelligence. It produces a smooth interface that offers graphical and clicks based solutions. It is user-friendly for the technical or the non-technical with advanced features.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"110State_some_features_of_SAS\"><\/span>110.State some features of SAS?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">There is some interlinked feature of SAS which includes;<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">It provides the user access to manage the resources just like that of the DBMS.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">It is leading with the leading analytical to carry out different business services and products.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">It enables easy visualization and interpretation with the use of graphs and its breaks the complex panels into simple plots.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">It is very efficient in delivering the business analysis which leads to manufacturing the products that can be distributed worldwide.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"111Describe_the_common_architecture_of_SharePoint_2010\"><\/span>111.Describe the common architecture of SharePoint 2010?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">There are three main architectural design of the SharePoint 2010 which includes;<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The enterprise farm which is uncommon as it completely is dedicated to the service and aids via the automated management with the feasible isolation of data.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">There is a single farm that is associated with multiple services whose potential advantages are managed via individual service application which enables a more complex targeting of sites to a particular application of service.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Lastly, the single farms employed in single service are very common and at the same time easy to deploy. The application service is simple to be allocated with fullest resource utilization and management.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"112Describe_the_log_analytics\"><\/span>112.Describe the log analytics?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">This question can be asked among the SQL Azure interview questions. The operational management service of Log Analytics provides the entire requirement that runs the particular service. It manifests automation, security, log analytics and availability at a particular dashboard. It generates Power data source that enables the user to get the visuals of the raw data. It is introduced in three different tiers of prices that include free, premium and standard. You enjoy the convenience of searching the data at a single dashboard and exporting the results.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"113If_the_client_gets_disconnected_from_cache_with_the_services_state_the_probable_cause\"><\/span>113.If the client gets disconnected from cache with the services state the probable cause?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">If the client gets disconnected the causal factor can be distributed into two categories;<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The cause on the operator side:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">There might be a failure in the transfer of the standard cache from one node to the other.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">While the service was processing and dispatching the cache got deployed.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">There was a server update or an automated VM maintenance.<\/span><\/li>\n<\/ul>\n<p><span style=\"font-weight: 400;\">The fault on the client side;<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The application of the client accidentally got redeployed.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The application on the client side got auto-scaling.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The layer of the network on the client side altered.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">There was a transient error on the network node.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The bound operation took more time.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The upper limit of the bandwidth was reached.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"114Explain_how_a_character_analytics_API_functions\"><\/span>114.Explain how a character analytics API functions?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The working of the character analytics of API does not account for the characterization of words like good or bad. It uses the advanced feature through which the processing of natural language is mediated.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"115_What_is_difference_between_IaaS_PaaS_and_SaaS\"><\/span>115. What is difference between IaaS, PaaS, and SaaS?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Iaas, PaaS, and SaaS are three major components of Azure and cloud computing.<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Infrastructure as a Service (IaaS)<\/b><\/li>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">With IaaS, you rent IT infrastructure \u2013 servers and virtual machines (VMs), storage, networks, operating systems \u2013 from a cloud provider on a pay-as-you-go basis.<\/span><\/li>\n<\/ul>\n<\/li>\n<li aria-level=\"1\"><b>Platform as a Service (PaaS)<\/b><\/li>\n<li style=\"list-style-type: none;\">\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Platform as a service (PaaS) refers to cloud computing services that supply an on-demand environment for developing, testing, delivering and managing software applications.<\/span><\/li>\n<\/ul>\n<\/li>\n<li aria-level=\"1\"><b>Software as a Service (SaaS)<\/b><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Software as a service (SaaS) is a method for delivering software applications over the Internet, on demand and typically on a subscription basis. With SaaS, cloud providers host and manage the software application and underlying infrastructure and handle any maintenance, such as software upgrades and security patching.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Learn more here: Introduction to Cloud Computing.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"116Why_do_we_need_Azure_Data_Factory\"><\/span>116.Why do we need Azure Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">As the world moves to the cloud and big data, data integration and migration remain an integral part of enterprises in all industries.\u00a0<\/span><b>ADF<\/b><span style=\"font-weight: 400;\">\u00a0helps solve both of these problems efficiently by focusing on the data and planning, monitoring, and managing the ETL \/ ELT pipeline in a single view.<\/span><\/p>\n<p><b>The reasons for the growing adoption of Azure Data Factory are:<\/b><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Increased value<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Improved results of business processes<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Reduced overhead costs<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Improved decision making<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Increased business process agility<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"117What_is_Azure\"><\/span>117.What is Azure?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Windows Azure is a cloud platform developed by Microsoft that enables businesses to completely run in the cloud. Cloud platform offers pay-as-you-go payment method to pay for the use of cloud services. For example, if you\u2019ve a database and you don\u2019t use it, you don\u2019t pay.<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">Azure offers every service in the cloud a company needs to run its business. It provides infrastructure, hardware, operating systems, document services, storage, databases, da<\/span><\/p>\n<p><span style=\"font-weight: 400;\">ta services, software, third party products, and anything you can imagine.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">You can also host your own virtual machines, web servers, database servers, and content storage in Azure. Azure is not only Windows but also supports Linux servers.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Learn more about Azure, continue reading: Introduction to Microsoft Azure.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"118Is_Azure_data_Factory_an_ETL_tool\"><\/span>118.Is Azure data Factory an ETL tool?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Data Factory is a cloud-based ETL and data integration service for creating data movement and transformation workflows. Data Factory allows you to design scheduled workflows (pipelines) without writing any code.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"119What_is_the_use_of_Azure_Data_Lake_in_Azure_data_Factory_ADF\"><\/span>119.What is the use of Azure Data Lake in Azure data Factory (ADF)?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b><\/b><b><\/b><span style=\"font-weight: 400;\">Azure Data Lake Storage Gen2 is a set of features integrated into Azure Blob storage that are focused on big data analytics. It enables interaction with data through both the file system and the object storage models. Azure Data Factory (ADF) is a cloud-based data integration service that is fully managed.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"120What_is_parameterization_in_Azure\"><\/span>120.What is parameterization in Azure?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">It allows us to provide the server name, database name, credentials, and so on dynamically while executing the pipeline, allowing us to reuse rather than building one for each request. Parameterization in Azure Data Factory is important to successful design and reusability, as well as reduced solution maintenance costs.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"121What_is_Global_parameters_in_Azure_Data_Factory\"><\/span>121.What is Global parameters in Azure Data Factory?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Global parameters are constants which can be used by a pipeline in any expression throughout a data factory. It comes in handy when we have several pipelines with the same parameter names and values. We can override these parameters in each environment when promoting a data factory using the continuous integration and deployment process (CI\/CD).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Global parameters are constants which can be used by a pipeline in any expression throughout a data factory. It comes in handy when we have several pipelines with the same parameter names and values. We can override these parameters in each environment when promoting a data factory using the continuous integration and deployment process (CI\/CD).<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Global parameters are constants which can be used by a pipeline in any expression throughout a data factory. It comes in handy when we have several pipelines with the same parameter names and values. We can override these parameters in each environment when promoting a data factory using the continuous integration and deployment process (CI\/CD)<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"122What_is_the_use_of_dataset_in_Azure_data_Factory\"><\/span>122.What is the use of dataset in Azure data Factory?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">A dataset is a named view of data that clearly points to or references the data we could use as inputs and outputs in activities. Datasets are used to identify data in various data storage, such as tables, files, folders, and documents.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"123What_is_Copy_activity_in_Azure_Data_Factory\"><\/span>123.What is Copy activity in Azure Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b><br \/>\n<\/b><span style=\"font-weight: 400;\">The Copy activity in Azure Data Factory can be used to copy data between on-premises and cloud data stores (<\/span><b>supported data stores and formats<\/b><span style=\"font-weight: 400;\">) and to use the copied data in additional transformation or analysis tasks.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"124What_are_the_types_of_Integration_Runtimes_in_Azure_Data_Factory\"><\/span>124.What are the types of Integration Runtimes in Azure Data Factory?<span style=\"font-weight: 400;\"><span style=\"font-weight: 400;\"><br \/>\n<\/span><\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Integration Runtimes in Azure Data Factory are classified into three types<\/span><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">1.The <\/span><b>Azure Integration Runtime<\/b><span style=\"font-weight: 400;\">\u00a0is utilised when copying data between data stores that are publicly accessible via the internet.<\/span><\/p>\n<p><b>2.Self-Hosted Integration Runtime<\/b><span style=\"font-weight: 400;\">\u00a0for copying data from or to an on-premises data store or from a network with access control.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">3.SSIS packages in the Data Factory are run using the <\/span><b>Azure SSIS Integration Runtime<\/b><span style=\"font-weight: 400;\">.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"125How_to_copy_data_from_an_Azure_Blob_Storage_text_file_to_an_Azure_SQL_Database_table\"><\/span>125.How to copy data from an Azure Blob Storage (text file) to an Azure SQL Database table?<b><\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Set up the Data Factory pipeline which will be used to copy data from the blob storage to the Azure SQL Database.<\/span><\/p>\n<ol>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Navigate to the Azure Portal and select the Author &amp; Monitor option.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Click on the Create Pipeline \/ Copy Data option.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Enter a unique name for the copy activity and select whether to schedule or execute it once for the Copy Data option -&gt; Click Next<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Select the type of source data store to link to in order to construct a Linked Service (Azure Blob Storage) and click Continue<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">A new Linked Service window will open -&gt; enter a unique name and other details -&gt; test the connection and then click Create.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">If you need to copy many files recursively, specify the input data file or folder (DataSet) and click Next.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Select Azure SQL Database from the list of New Linked Services, then click Continue to configure the new Linked service.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Fill out all of the information in the New Linked Service window -&gt; Test Connection -&gt; Create<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Create the sink dataset with the destination database table specified.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Copy Data Tool -&gt; Settings -&gt; Next -&gt; Review all the copy configuration from the Summary Window -&gt; Next -&gt; Finish<\/span><\/li>\n<\/ol>\n<h2><span class=\"ez-toc-section\" id=\"126_Briefly_explain_different_components_of_Azure_Data_Factory\"><\/span><span style=\"font-weight: 400;\">126. Briefly explain different components of Azure Data Factory:<br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>Pipeline:<\/b><span style=\"font-weight: 400;\">\u00a0It represents activities logical container.\u00a0<\/span><\/p>\n<p><b>Dataset:<\/b><span style=\"font-weight: 400;\">\u00a0It is a pointer to the data utilized in the pipeline activities\u00a0<\/span><\/p>\n<p><b>Mapping Data Flow<\/b><span style=\"font-weight: 400;\">: Represents a data transformation UI logic\u00a0<\/span><\/p>\n<p><b>Activity:\u00a0<\/b><span style=\"font-weight: 400;\">In the Data Factory pipeline, Activity is the execution step that can be utilized for data consumption and transformation.\u00a0<\/span><\/p>\n<p><b>Trigger:\u00a0<\/b><span style=\"font-weight: 400;\">Mentions the time of pipeline execution.<\/span><\/p>\n<p><b>Linked Service:\u00a0<\/b><span style=\"font-weight: 400;\">It represents an explanatory connection string for those data sources being used in the pipeline activities\u00a0<\/span><\/p>\n<p><b>Control flow:\u00a0<\/b><span style=\"font-weight: 400;\">Regulates the execution flow of the pipeline activities\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"127What_is_the_need_for_Azure_Data_Factory\"><\/span>127.What is the need for Azure Data Factory<span style=\"font-weight: 400;\">?<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">While going through\u00a0<\/span><b>azure tutorial<\/b><span style=\"font-weight: 400;\">, you would come across this terminology. Since data comes from different sources, it can be in any form. Such varied sources will transfer or channelize the particular data in various ways and the same can be in a varied format. Whenever we convey this data on the cloud or specific storage, it is inevitable to ascertain that this data is efficiently managed. So, you have to transform the data and remove unnecessary parts.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"128Is_there_any_limit_on_how_many_integration_runtimes_can_be_performed\"><\/span>128.Is there any limit on how many integration runtimes can be performed?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">No, there is no limit on the number of integration runtime occurrences you can have in an Azure data factory. However, there is a limit on the number of VM cores that the integration runtime can utilize for every subscription for SSIS package implementation. When you pursue\u00a0<\/span><b>Microsoft Azure Certification<\/b><span style=\"font-weight: 400;\">, you should be aware of these terms.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"129Explain_Data_Factory_Integration_Runtime\"><\/span>129.Explain Data Factory Integration Runtime?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Integration Runtime is a safe computing infrastructure being used by Data Factory for offering data integration abilities over various network environments. Moreover, it ascertains that such activities will get implemented in the nearest possible area to the data store. If you want to\u00a0<\/span><b>Learn Azure Step by step<\/b><span style=\"font-weight: 400;\">, you must be aware of this and other such fundamental Azure terminologies.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"130Mention_about_three_types_of_triggers_that_Azure_Data_Factory_supports\"><\/span>130.Mention about three types of triggers that Azure Data Factory supports?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The Schedule trigger is useful for the execution of the ADF pipeline on a wall-clock timetable.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The Tumbling window trigger is useful for the execution of the ADF pipeline over a cyclic interval. It holds on to the pipeline state.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The Event-based trigger responds to an event that is related to blob. Examples of such events include adding or deleting a blob from your Azure storage account.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"131_What_it_means_by_blob_storage_in_Azure\"><\/span>131. What it means by blob storage in Azure?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Blob storage in\u00a0<\/span><b>Azure<\/b><span style=\"font-weight: 400;\">\u00a0is one of the key aspects to learn if you want to get\u00a0<\/span><b>Azure fundamentals certification<\/b><span style=\"font-weight: 400;\">. Azure Blob Storage is a service very useful for the storage of massive amounts of unstructured object data like binary data or text. Moreover, you can use Blob Storage to render data to the world or for saving application data confidentially. Typical usages of Blob Storage include:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Directly serving images or documents to a browser<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Storage of files for distributed access<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Streaming audio and video<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Storing data for backup and reinstate disaster recovery, and archiving<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Storing data for investigation by an on-premises or any Azure-hosted service<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"132Mentions_the_steps_for_creating_ETL_process_in_Azure_Data_Factory\"><\/span>132.Mentions the steps for creating ETL process in Azure Data Factory?<b><\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">When attempting to retrieve some data from Azure SQL server database, if anything needs to be processed, it would be processed and saved in the Data Lake Store. Here are the steps for creating ETL:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Firstly, create a Linked Service for source data store i.e. SQL Server Database<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Suppose that we are\u00a0 using a cars dataset<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Now create a Linked Service for a destination data store that is Azure Data Lake Store<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">After that, create a dataset for Data Saving<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Setup the pipeline and add copy activity<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Finally, schedule the pipeline by inserting a trigger<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"133Mention_about_three_types_of_triggers_that_Azure_Data_Factory_supports\"><\/span>133.Mention about three types of triggers that Azure Data Factory supports?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The Schedule trigger is useful for the execution of the ADF pipeline on a wall-clock timetable.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The Tumbling window trigger is useful for the execution of the ADF pipeline over a cyclic interval. It holds on to the pipeline state.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The Event-based trigger responds to an event that is related to blob. Examples of such events include adding or deleting a blob from your Azure storage account.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"134How_to_create_Azure_Functions\"><\/span>134.How to create Azure Functions?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Functions are solutions for implementing small lines of functions or code in the cloud. With these functions, we can choose preferred programming languages. You need to pay only for the time the code runs which means that you need to pay per usage. It supports a wide range of programming languages including F#, C#, Node.js, Java, Python, or PHP. Also, it supports continuous deployment as well as integration. It is possible to develop serverless applications through Azure Functions applications. When you enroll for\u00a0<\/span><b>Azure Training In Hyderabad<\/b><span style=\"font-weight: 400;\">,\u00a0you can thoroughly know how to create Azure Functions.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"135What_are_the_steps_to_access_data_through_the_use_of_the_other_80_dataset_types_in_Data_Factory\"><\/span>135.What are the steps to access data through the use of the other 80 dataset types in Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Currently, the Mapping Data Flow functionality allows Azure SQL Data Warehouse, Azure SQL Database, defined text files from Azure Blob storage or Azure Data Lake Storage Gen2, and Parquet files from Blob storage or Data Lake Storage Gen2 natively for sink and source.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">You need to use the Copy activity to point data from any of the supplementary connectors. Subsequently, you need to run a Data Flow activity to efficiently transform data after it is already staged.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"136What_do_you_need_for_executing_an_SSIS_package_in_Data_Factory\"><\/span>136.What do you need for executing an SSIS package in Data Factory?\u00a0<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">You have to create an SSIS IR and an SSISDB catalog which is hosted in Azure SQL Managed Instance or Azure SQL Database.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"137What_are_Datasets_in_ADF\"><\/span>137.What are Datasets in ADF?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The dataset is the data that you would use in your pipeline activities in form of inputs and outputs. Generally, datasets signify the structure of data inside linked data stores like documents, files, folders, etc. For instance, an Azure blob dataset describes the folder and container in blob storage from which a specific pipeline activity must read data as input for processing<\/span><span style=\"font-weight: 400;\">.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"138What_is_the_use_of_the_ADF_Service\"><\/span>138.What is the use of the ADF Service?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">ADF is primarily used to organize the data copying between various relational and non-relational data sources that are being hosted locally in your datacenters or in the cloud. Moreover, ADF Service can be used for the transformation of the ingested data to fulfill your business requirements. In most Big Data solutions, ADF Service is used as an ETL or ELT tool for data ingestion. When you enroll for Azure Training In Hyderabad, you can thoroughly know the usefulness of ADF Service.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"139How_do_the_Mapping_data_flow_and_Wrangling_data_flow_transformation_activities_differ_in_Data_Factory\"><\/span>139.How do the Mapping data flow and Wrangling data flow transformation activities differ in Data Factory?\u00a0<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Mapping data flow activity is a data transformation activity that is visually designed. It enables you to effectively design graphical data transformation logic in absence of an expert developer. Moreover, it is operated as an activity inside the ADF pipeline on a fully-managed ADF scaled-out Spark cluster.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">On the other hand, wrangling data flow activity denotes a data preparation activity that does not use code. It integrates with Power Query Online for making the Power Query M functions accessible for data wrangling through spark implementation.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"140What_Are_Azure_Databricks\"><\/span>140.What Are Azure Databricks?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>Azure Databricks<\/b><span style=\"font-weight: 400;\">\u00a0represent an easy, quick, and mutual Apache Spark based analytics platform that is optimized for Azure. It is being designed in partnership with the founders of Apache Spark. Moreover, Azure Databricks blends the finest of Databricks and Azure to let customers speed up innovation through a quick setup. The smooth workflows and an engaging workspace facilitate teamwork between data engineers, data scientists, and business analysts.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"141What_is_Azure_SQL_Data_Warehouse\"><\/span>141.What is Azure SQL Data Warehouse?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">It is a huge storage of data collected from a broad range of sources in a company and useful to make management decisions. These warehouses enable you to accumulate data from diverse databases existing as either remote or distributed systems.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">An Azure SQL Data Warehouse can be created by integrating data from multiple sources which can be utilized for decision making, analytical reporting, etc. In other words, it is a cloud-based enterprise application allowing you to function under parallel processing to rapidly examine a complex query from the massive data volume. Also, it works as a solution for Big-Data concepts.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"142What_is_Azure_Data_Lake\"><\/span>142.What is Azure Data Lake?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Data Lake streamlines processing tasks and data storage for analysts, developers, and data scientists. It is an advanced mechanism that supports the mentioned tasks across multiple platforms and languages.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">It removes the barriers linked with data storage. Also, it makes it simpler to carry out steam, batch, and interactive analytics. Features in Azure Data Lake resolve the challenges linked with productivity and scalability and fulfill growing business requirements.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"143Explain_data_source_in_the_azure_data_factory\"><\/span>143.Explain data source in the azure data factory:<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The data source is the source or destination system that comprises the data intended to be utilized or executed upon. Type of data can be binary, text, csv files, json files, etc. It can be\u00a0 image files, video, audio, or might be a proper database.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Examples of data source include azure data lake storage, Azure blob storage, or any other database such as mysql db, Azure sql databsse, postgres, etc.\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"144Wahy_is_it_beneficial_to_use_the_Auto_Resolve_Integration_Runtime\"><\/span>144.Wahy is it beneficial to use the Auto Resolve Integration Runtime ?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">AutoResolveIntegrationRuntime automatically tries to execute the activities in the same region or in close proximity to the region of the particular sink data source. The same can boost performance.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"145How_is_lookup_activity_useful_in_the_azure_data_factory\"><\/span>145.How is lookup activity useful in the azure data factory?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">In the ADF pipeline, the Lookup activity is commonly used for configuration lookup purposes. The source dataset is available in it. Moreover, it is used to retrieve the data from the source dataset and then send it as the output of the activity. Generally, the output of the lookup activity is further used in the pipeline for taking some decisions or presenting any configuration as a result.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">In simple terms, lookup activity is used for data fetching in ADF pipeline. The way you would use it entirely relies on your pipeline logic. It is possible to obtain only the first row or you can retrieve the complete rows depending on your dataset or query.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"146What_are_the_types_of_variables_in_the_azure_data_factory\"><\/span>146.What are the types of variables in the azure data factory?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Variables in the ADF pipeline allow temporary holding of the values. Their usage is similar just to the variables used in the programming language. For assigning and manipulating the variable values, two types of activities are used i.e. Set Variable and append variable.\u00a0<\/span><\/p>\n<p><b>Two types of variables in Azure data factory are:<\/b><\/p>\n<ul>\n<li aria-level=\"1\"><b>\u00a0System variable:<\/b><span style=\"font-weight: 400;\">\u00a0These are the fixed variable from the Azure pipeline. Their examples include pipeline id, pipeline name, trigger name, etc.<\/span><b>\u00a0<\/b><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>User variable:<\/b><span style=\"font-weight: 400;\">\u00a0User variables are manually declared depending on the logic of the pipeline.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"147Explain_the_linked_service_in_the_azure_data_factory\"><\/span>147.Explain the linked service in the azure data factory?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">In\u00a0<\/span><a href=\"https:\/\/www.dotnettricks.com\/learn\/azure\/azure-data-factory\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Azure Data Factory<\/span><\/a><span style=\"font-weight: 400;\">, linked service represents the connection system used to connect the external source. It functions as the connection string for holding the user validation information.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Two ways to create the linked service are:<\/span><\/p>\n<ol>\n<li><span style=\"font-weight: 400;\"> ARM template way<\/span><\/li>\n<li><span style=\"font-weight: 400;\"> Using the Azure Portal<\/span><\/li>\n<\/ol>\n<h2><span class=\"ez-toc-section\" id=\"148What_does_it_mean_by_the_breakpoint_in_the_ADF_pipeline\"><\/span>148.What does it mean by the breakpoint in the ADF pipeline?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Breakpoint signifies the debug portion of the pipeline. If you wish to check the pipeline with any specific activity, you can accomplish it through the breakpoints.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">To understand better, for example, you are using 3 activities in the pipeline and now you want to debug up to the second activity only. This can be done by placing the breakpoint at the second activity. To add a breakpoint, you can click the circle present at the top of the activity.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"149What_is_the_difference_between_the_Dataset_and_Linked_Service_in_Data_Factory\"><\/span>149.What is the difference between the Dataset and Linked Service in Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Linked Service is a description of the connection string that is used to connect to the data stores. For example, when ingesting data from a SQL Server instance, the linked service contains the name for the SQL Server instance and the credentials used to connect to that instance.<\/span><\/p>\n<ol>\n<li><span style=\"font-weight: 400;\">Dataset is a reference to the data store that is described by the linked service. When ingesting data from a SQL Server instance, the dataset points to the name of the table that contains the target data or the query that returns data from different tables.<\/span><\/li>\n<\/ol>\n<h2><span class=\"ez-toc-section\" id=\"150Data_Factory_consists_of_a_number_of_components_Mention_these_components_briefly\"><\/span>150.Data Factory consists of a number of components. Mention these components briefly<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Pipeline: The activities logical container<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Activity: An execution step in the Data Factory pipeline that can be used for data ingestion and transformation<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Mapping Data Flow: A data transformation UI logic<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Dataset: A pointer to the data used in the pipeline activities<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Linked Service: A descriptive connection string for the data sources used in the pipeline activities<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Trigger: Specify when the pipeline will be executed<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Control flow: Controls the execution flow of the pipeline activities<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">_For more information, check\u00a0_<\/span><b>Starting your journey with Microsoft Azure Data Factory<\/b><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"151After_installing_the_Self-Hosted_Integration_Runtime_to_the_machine_where_the_SQL_Server_instance_is_hosted_how_could_we_associate_the_SH-IR_created_from_the_Data_Factory_portal\"><\/span>151.After installing the Self-Hosted Integration Runtime to the machine where the SQL Server instance is hosted, how could we associate the SH-IR created from the Data Factory portal?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">We need to register it using the authentication key provided by the ADF portal.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"152What_is_the_difference_between_the_Mapping_data_flow_and_Wrangling_data_flow_transformation_activities_in_Data_Factory\"><\/span>152.What is the difference between the Mapping data flow and Wrangling data flow transformation activities in Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Mapping data flow activity is a visually designed data transformation activity that allows us to design a graphical data transformation logic without the need to be an expert developer, and executed as an activity within the ADF pipeline on an ADF fully managed scaled-out Spark cluster.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Wrangling data flow activity is a code-free data preparation activity that integrates with Power Query Online in order to make the Power Query M functions available for data wrangling using spark execution.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"153Data_Factory_supports_two_types_of_compute_environments_to_execute_the_transform_activities_Mention_these_two_types_briefly\"><\/span>153.Data Factory supports two types of compute environments to execute the transform activities. Mention these two types briefly<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">On-demand compute environment, using a computing environment fully managed by the ADF. In this compute type, the cluster will be created to execute the transform activity and removed automatically when the activity is completed.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Bring Your Own environment, in which the used compute environment is managed by you and ADF.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"154What_is_Azure_SSIS_Integration_Runtime\"><\/span>154.What is Azure SSIS Integration Runtime?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">A fully managed cluster of virtual machines hosted in Azure and dedicated to run SSIS packages in the Data Factory. The SSIS IR nodes can be scaled up, by configuring the node size, or scaled out by configuring the number of nodes in the VMs cluster.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"155What_is_required_to_execute_an_SSIS_package_in_Data_Factory\"><\/span>155.What is required to execute an SSIS package in Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">We need to create an SSIS IR and an SSISDB catalog hosted in Azure SQL Database or Azure SQL Managed Instance.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"156Which_Data_Factory_activity_is_used_to_run_an_SSIS_package_in_Azure\"><\/span>156.Which Data Factory activity is used to run an SSIS package in Azure?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Execute SSIS Package activity.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"157Data_Factory_supports_three_types_of_triggers_Mention_these_types_briefly\"><\/span>157.Data Factory supports three types of triggers. Mention these types briefly<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\"><br \/>\n<\/span><span style=\"font-weight: 400;\">The Schedule trigger that is used to execute the ADF pipeline on a wall-clock schedule<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The Tumbling window trigger that is used to execute the ADF pipeline on a periodic interval, and retains the pipeline state<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The Event-based trigger that responds to a blob related event, such as adding or deleting a blob from an Azure storage account<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"158Any_Data_Factory_pipeline_can_be_executed_using_three_methods_Mention_these_methods\"><\/span>158.Any Data Factory pipeline can be executed using three methods. Mention these methods<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Under Debug mode<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Manual execution using Trigger now<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Using an added scheduled, tumbling window or event trigger<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"159From_where_we_can_monitor_the_execution_of_a_pipeline_that_is_executed_under_the_Debug_mode\"><\/span>159.From where we can monitor the execution of a pipeline that is executed under the Debug mode?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The Output tab of the pipeline, without the ability to use the Pipeline runs or Trigger runs under ADF Monitor window to monitor it.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"160What_are_the_advantages_of_Azure_Resource_Manager\"><\/span>160.What are the advantages of Azure Resource Manager?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>The advantages of Azure Resource Manager are:<\/b><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The resource manager helps us to manage the usage of the application resources. The insured resource manager is called ARM.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">The ARM helps deploy, manage, and monitor all the resources for an application, a solution, or a group.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Users can be granted access to resources that they require within a resource manager.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">It helps retrieve groups billing resources. Which group is using more, which group is using less, and which group has contributed more to this month\u2019s bill? Stuff like that. Those details can be obtained using\u00a0<\/span><b>Azure Resource Manager<\/b><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Provisioning resources is made much easier with the help of this resource manager.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"161How_has_integrated_hybrid_cloud_been_useful_for_Azure\"><\/span>161.How has integrated hybrid cloud been useful for Azure?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>The integration of hybrid cloud has been useful for Azure in the following ways:<\/b><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">We get the best of both worlds since applications and data can be shared between the public and private clouds.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Seamless on-premise infrastructure scalability.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">It boosts the productivity of the on-premises application.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">We get a greater efficiency with a combination of Azure services, DevOps processing tools for the application running on-premises.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Users can take advantage of a constantly updated Azure service and other\u00a0<\/span><b>AWS<\/b><span style=\"font-weight: 400;\">\u00a0marketplace applications for their on-premises environment.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">We are not worried about the deployment locations<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"162hat_kind_of_storage_is_best_suited_to_handle_unstructured_data\"><\/span>162.hat kind of storage is best suited to handle unstructured data?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><b>Block storage<\/b><span style=\"font-weight: 400;\">\u00a0is well-suited because block storage is designed to support unstructured data. It places the data into different tiers based on how often they are accessed.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"163Azure_Data_Factory_Execute_Pipeline_Activity_Example\"><\/span>163.Azure Data Factory Execute Pipeline Activity Example<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The\u00a0<\/span><i><span style=\"font-weight: 400;\">Execute Pipeline<\/span><\/i><span style=\"font-weight: 400;\">\u00a0activity can be used to invoke another pipeline. This activity\u2019s functionality is similar to SSIS\u2019s\u00a0<\/span><a href=\"https:\/\/docs.microsoft.com\/en-us\/sql\/integration-services\/control-flow\/execute-package-task?view=sql-server-2017\" target=\"_blank\" rel=\"noopener\"><span style=\"font-weight: 400;\">Execute Package Task<\/span><\/a><span style=\"font-weight: 400;\">\u00a0and you can use it to create complex data flows, by nesting multi-level pipelines inside each other. This activity also allows passing parameter values from parent to child pipeline.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Add string parameter\u00a0<\/span><i><span style=\"font-weight: 400;\">PL_TableName\u00a0<\/span><\/i><span style=\"font-weight: 400;\">to\u00a0<\/span><i><span style=\"font-weight: 400;\">ExploreSQLSP_PL\u00a0<\/span><\/i><span style=\"font-weight: 400;\">pipeline<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Assign activity parameter\u00a0<\/span><i><span style=\"font-weight: 400;\">TableName\u00a0<\/span><\/i><span style=\"font-weight: 400;\">to pipeline parameter<\/span><i><span style=\"font-weight: 400;\">\u00a0PL_TableName<\/span><\/i><\/p>\n<p><span style=\"font-weight: 400;\">Select activity SP_AC, switch to the\u00a0<\/span><i><span style=\"font-weight: 400;\">Stored Procedure<\/span><\/i><span style=\"font-weight: 400;\">\u00a0tab, hit value textbox for\u00a0<\/span><i><span style=\"font-weight: 400;\">TableName<\/span><\/i><span style=\"font-weight: 400;\">\u00a0parameter and click \u2018<\/span><i><span style=\"font-weight: 400;\">Add dynamic content<\/span><\/i><span style=\"font-weight: 400;\">\u2018 link under that text box:<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"164Azure_Data_Factory_Lookup_Activity\"><\/span>164.Azure Data Factory Lookup Activity?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The Lookup activity can read data stored in a database or file system and pass it to subsequent copy or transformation activities. Unlike SSIS&#8217;s\u00a0Lookup transformation, which allows performing a lookup search at the row level, data obtained from ADF&#8217;s Lookup activity can only be used on an object level. In other words, you can use ADF&#8217;s Lookup activity&#8217;s data to determine object names (table, file names, etc.) within the same pipeline dynamically.<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Lookup activity can read from a variety of database and file-based sources, you can find the list of all possible data sources\u00a0<\/span><b>here<\/b><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Lookup activity can work in two modes:<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Singleton mode &#8211; Produces first row of the related dataset<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Array mode &#8211; Produces the entire dataset<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">We will look into both modes of Lookup activity in this post.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"165Azure_Data_Factory_Triggers\"><\/span>165.Azure Data Factory Triggers?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">ADF v2 has introduced a concept of triggers as a way to automate pipeline executions. Triggers represent a unit of processing that determines when a pipeline execution needs to be initiated. The same pipeline could be kicked-off more than once and each execution of it would have its own run ID. Pipelines and triggers have a many-to-many relationship. Multiple triggers can kick-off a single pipeline, or a single trigger can kick off multiple pipelines. Here is the list of different trigger types available in ADF:<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"166What_are_Data_Flows_in_Azure_Data_Factory\"><\/span>166.What are Data Flows in Azure Data Factory?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The Azure Data Factory (ADF) service was introduced in the tip <\/span><b>\u00a0Getting Started with Azure Data Factory &#8211; Part <\/b><span style=\"font-weight: 400;\">1\u00a0and\u00a0<\/span><b>Part 2<\/b><span style=\"font-weight: 400;\">. There we explained that ADF is an orchestrator of data operations, just like\u00a0Integration Services <\/span><b>(SSIS<\/b><span style=\"font-weight: 400;\">). But we skipped the concepts of data flows in ADF, as it was out of scope. This tip aims to fill this void.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">A data flow in ADF allows you to pull data into the ADF runtime, manipulating it on-the-fly and then writing it back to a destination. Data flows in ADF are similar to the concept of data flows in SSIS, but more scalable and flexible. There are two types of data flows:<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Data flow &#8211;<\/b><span style=\"font-weight: 400;\">\u00a0This is the regular data flow, previously called the\u00a0<\/span><i><span style=\"font-weight: 400;\">mapping data flow<\/span><\/i><span style=\"font-weight: 400;\">.<\/span><\/li>\n<li aria-level=\"1\"><b>Power Query &#8211;<\/b><span style=\"font-weight: 400;\"> This data flow uses the Power Query technology, which can also be found in Power BI Desktop, Analysis Services Tabular and the &#8220;Get Data&#8221; feature in Excel. At the time of writing, it is still in preview. Previously, this data flow was called the &#8220;wrangling data flow&#8221;.<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"167Azure_Data_Factory_Pipeline_Scheduling_Error_Handling_and_Monitoring\"><\/span>167.Azure Data Factory Pipeline Scheduling, Error Handling and Monitoring ?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">It&#8217;s recommended to read\u00a0<\/span><b>part 1\u00a0<\/b><span style=\"font-weight: 400;\">before you continue with this tip. It shows you how to install ADF and how to create a pipeline that will copy data from Azure Blob Storage to an Azure SQL database as a sample ETL \\ ELT process.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"168Azure_Data_Factory_for_Web_Scraping\"><\/span>168.Azure Data Factory for Web Scraping?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Web scraping is a term used to extract data from a website in an automated way. There are multiple ways to fetch data from a webpage, and you can use scripts such as Python, R, .NET, Java or tools such as Azure Data Factory.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Azure Data Factory is an Azure cloud infrastructure ETL (Extract-Transform-Load) functionality. It provides a code-free user interface with the scale-out serverless data integration and data transformation. You can configure data driven workflows for orchestrating and automating data transformation and data movement.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"169Transfer_Data_to_the_Cloud_Using_Azure_Data_Factory\"><\/span>169.Transfer Data to the Cloud Using Azure Data Factory?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">For the purpose of this exercise, I have downloaded and installed the\u00a0<\/span><b>AdventureWorks 2016 database <\/b><span style=\"font-weight: 400;\">on my local SQL Server. This database contains DimDate table, with 3652 rows and DateKey as PK constraint. I have generated the below script for this table, which I will use to create a target table in Azure SQL database DstDb:<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"170Data_Factory_Concepts_Mapping_with_SSIS\"><\/span>170.Data Factory Concepts Mapping with SSIS?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">For those who are coming from conventional SQL Server Integration Services background following table provide high level mapping between different components of SSIS and Azure Data Factory.<\/span><\/p>\n<ul>\n<li aria-level=\"1\"><b>Data Factory<\/b><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>SSIS<\/b><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Pipeline<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Package (*.dtsx) or Control Flow<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Activity<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">SSIS Control flow Components<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Linked Services<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Connections<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Dataset<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Connection Mapping<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Workflow<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Dataflow<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"171Why_Azure_Data_Factory\"><\/span>171.Why Azure Data Factory?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Cloud Need an Orchestration Tool<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Extract Data from Cloud Source<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Transform Data using Datafactory workflows<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Load\/Sink data into Datalake or datawarehouse<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"172ETL_process_in_Azure_Data_Factory\"><\/span>172.ETL process in Azure Data Factory<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Following are high level steps to create a simple pipeline in ADF. Following example copy data from SQL Server DB to Azure Data Lake.<\/span><\/p>\n<p><b>Steps for Creating ETL<\/b><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Create a Linked Service for source data store which is SQL Server Database<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Create Source Dataset using Source Link Service<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Create a Linked Service for destination data store which is Azure Data Lake Store<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Create Sink\/Target Dataset using link Service created in Step 3<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Create the pipeline and add copy activity<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Schedule the pipeline by adding a trigger<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"173Define_default_values_for_the_Pipeline_Parameters\"><\/span>173.Define default values for the Pipeline Parameters?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">You can define default values for the parameters in the pipelines.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"174Can_an_activity_output_property_be_consumed_in_another_activity\"><\/span>174.Can an activity output property be consumed in another activity?<b><br \/>\n<\/b><b><\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">An activity output can be consumed in a subsequent activity with the @activity construct.<\/span><b><\/b><\/p>\n<h2><span class=\"ez-toc-section\" id=\"175Data_Factory_consists_of_a_number_of_components_Mention_these_components_briefly\"><\/span>175.Data Factory consists of a number of components. Mention these components briefly<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Pipeline: The activities logical container<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Activity: An execution step in the Data Factory pipeline that can be used for data ingestion and transformation<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Mapping Data Flow: A data transformation UI logic<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Dataset: A pointer to the data used in the pipeline activities<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Linked Service: A descriptive connection string for the data sources used in the pipeline activities<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Trigger: Specify when the pipeline will be executed<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Control flow: Controls the execution flow of the pipeline activities<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"176What_is_the_difference_between_the_Dataset_and_Linked_Service_in_Data_Factory\"><\/span>176.What is the difference between the Dataset and Linked Service in Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Linked Service is a description of the connection string that is used to connect to the data stores. For example, when ingesting data from a SQL Server instance, the linked service contains the name for the SQL Server instance and the credentials used to connect to that instance.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Dataset is a reference to the data store that is described by the linked service. When ingesting data from a SQL Server instance, the dataset points to the name of the table that contains the target data or the query that returns data from different tables.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"177What_is_Data_Factory_Integration_Runtime\"><\/span>177.What is Data Factory Integration Runtime?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Integration Runtime is a secure compute infrastructure that is used by Data Factory to provide the data integration capabilities across the different network environments and make sure that these activities will be executed in the closest possible region to the data store.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"178Data_Factory_supports_three_types_of_Integration_Runtimes_Mention_these_supported_types_with_a_brief_description_for_each\"><\/span>178.Data Factory supports three types of Integration Runtimes. Mention these supported types with a brief description for each?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Integration Runtime: used for copying data from or to data stores accessed publicly via the internet<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Self-Hosted Integration Runtime: used for copying data from or to an on-premises data store or networks with access control<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Azure SSIS Integration Runtime: used to run SSIS packages in the Data Factory<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"179What_is_the_difference_between_the_Mapping_data_flow_and_Wrangling_data_flow_transformation_activities_in_Data_Factory\"><\/span>179.What is the difference between the Mapping data flow and Wrangling data flow transformation activities in Data Factory?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Mapping data flow activity is a visually designed data transformation activity that allows us to design a graphical data transformation logic without the need to be an expert developer, and executed as an activity within the ADF pipeline on an ADF fully managed scaled-out Spark cluster.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Wrangling data flow activity is a code-free data preparation activity that integrates with Power Query Online in order to make the Power Query M functions available for data wrangling using spark execution<\/span><span style=\"font-weight: 400;\">.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"180Data_Factory_supports_two_types_of_compute_environments_to_execute_the_transform_activities_Mention_these_two_types_briefly\"><\/span>180.Data Factory supports two types of compute environments to execute the transform activities. Mention these two types briefly?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">On-demand compute environment, using a computing environment fully managed by the ADF. In this compute type, the cluster will be created to execute the transform activity and removed automatically when the activity is completed.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Bring Your Own environment, in which the used compute environment is managed by you and ADF<\/span><span style=\"font-weight: 400;\">.<\/span><b><\/b><\/p>\n<h2><span class=\"ez-toc-section\" id=\"181What_is_Azure_SSIS_Integration_Runtime\"><\/span>181.What is Azure SSIS Integration Runtime?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">A fully managed cluster of virtual machines hosted in Azure and dedicated to run SSIS packages in the Data Factory. The SSIS IR nodes can be scaled up, by configuring the node size, or scaled out by configuring the number of nodes in the VMs cluster.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"182What_is_required_to_execute_an_SSIS_package_in_Data_Factory\"><\/span>182.What is required to execute an SSIS package in Data Factory?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">We need to create an SSIS IR and an SSISDB catalog hosted in Azure SQL Database or Azure SQL Managed Instance<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"183Which_Data_Factory_activities_can_be_used_to_iterate_through_all_files_stored_in_a_specific_storage_account_making_sure_that_the_files_smaller_than_1KB_will_be_deleted_from_the_source_storage_account\"><\/span>183.Which Data Factory activities can be used to iterate through all files stored in a specific storage account, making sure that the files smaller than 1KB will be deleted from the source storage account?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">For Each activity for iteration<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Get Metadata to get the size of all files in the source storage<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">If Condition to check the size of the files<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Delete activity to delete all files smaller than 1KB<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"184Data_Factory_supports_three_types_of_triggers_Mention_these_types_briefly\"><\/span>184.Data Factory supports three types of triggers. Mention these types briefly<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The Schedule trigger that is used to execute the ADF pipeline on a wall-clock schedule<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The Tumbling window trigger that is used to execute the ADF pipeline on a periodic interval, and retains the pipeline state<\/span><\/p>\n<p><span style=\"font-weight: 400;\">The Event-based trigger that responds to a blob related event, such as adding or deleting a blob from an Azure storage account<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"185Any_Data_Factory_pipeline_can_be_executed_using_three_methods_Mention_these_methods\"><\/span>185.Any Data Factory pipeline can be executed using three methods. Mention these\u00a0 methods<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Under Debug mode<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Manual execution using Trigger now<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Using an added scheduled, tumbling window or event trigger<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"186From_where_we_can_monitor_the_execution_of_a_pipeline_that_is_executed_under_the_Debug_mode\"><\/span>186.From where we can monitor the execution of a pipeline that is executed under the Debug mode?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The Output tab of the pipeline, without the ability to use the Pipeline runs or Trigger runs under ADF Monitor window to monitor it.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"187Briefly_describe_the_purpose_of_the_ADF_Service\"><\/span>187.Briefly describe the purpose of the ADF Service?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">ADF is used mainly to orchestrate the data copying between different relational and non-relational data sources, hosted in the cloud or locally in your datacenters. Also, ADF can be used for transforming the ingested data to meet your business requirements. It is ETL, or ELT tool for data ingestion in most Big Data solutions.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"188Data_Factory_consists_of_a_number_of_components_Mention_these_components_briefly\"><\/span>188.Data Factory consists of a number of components. Mention these components briefly?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Pipeline: The activities logical container<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Activity: An execution step in the Data Factory pipeline that can be used for data ingestion and transformation<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Mapping Data Flow: A data transformation UI logic<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Dataset: A pointer to the data used in the pipeline activities<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Linked Service: A descriptive connection string for the data sources used in the pipeline activities<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Trigger: Specify when the pipeline will be executed<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Control flow: Controls the execution flow of the pipeline activities<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"189Briefly_describe_the_purpose_of_the_ADF_Service\"><\/span>189.Briefly describe the purpose of the ADF Service?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">ADF is used mainly to orchestrate the data copying between different relational and non-relational data sources, hosted in the cloud or locally in your datacenters. Also, ADF can be used for transforming the ingested data to meet your business requirements. It is ETL, or ELT tool for data ingestion in most Big Data solutions.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"190Is_Azure_Data_Factory_Certification_worth_doing\"><\/span>190.Is Azure Data Factory Certification worth doing?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Absolutely, there is a massive demand for Azure Data Engineers proficient in Data Factory. Since lots of companies are adopting Microsoft Azure as a cloud computing platform, so companies need skilful professionals to handle their operations.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Yes, ADF is the best tool available in the market for ETL processes. Without writing any complex\u00a0<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"191Is_Azure_Data_Factory_an_ETL_tool\"><\/span>191.Is Azure Data Factory an ETL tool?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">algorithms, it simplifies the entire data migration process.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"192Data_transformed_at_scale_with_code-free_pipelines\"><\/span>192.Data transformed at scale with code-free pipelines?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">The new browser-based tooling experience provides code-free pipeline authoring and deployment with a modern, interactive web-based experience.<\/span><\/p>\n<p><span style=\"font-weight: 400;\">For visual data developers and data engineers, the Data Factory web UI is the code-free design environment that you will use to build pipelines. It&#8217;s fully integrated with Visual Studio Online Git and provides integration for CI\/CD and iterative development with debugging options.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"193Briefly_explain_different_components_of_Azure_Data_Factory\"><\/span>193.Briefly explain different components of Azure Data Factory?<b><\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<ul>\n<li aria-level=\"1\"><b>Pipeline:<\/b><span style=\"font-weight: 400;\">\u00a0It represents activities logical container.\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Dataset:<\/b><span style=\"font-weight: 400;\">\u00a0It is a pointer to the data utilized in the pipeline activities\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Mapping Data Flow<\/b><span style=\"font-weight: 400;\">: Represents a data transformation UI logic\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Activity:\u00a0<\/b><span style=\"font-weight: 400;\">In the Data Factory pipeline, Activity is the execution step that can be utilized for data consumption and transformation.\u00a0<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Trigger:\u00a0<\/b><span style=\"font-weight: 400;\">Mentions the time of pipeline execution.<\/span><\/li>\n<\/ul>\n<ul>\n<li aria-level=\"1\"><b>Linked Service:\u00a0<\/b><span style=\"font-weight: 400;\">It represents an explanatory connection string for those data sources being used in the pipeline activities\u00a0<\/span><\/li>\n<li aria-level=\"1\"><b>Control flow:\u00a0<\/b><span style=\"font-weight: 400;\">Regulates the execution flow of the pipeline activities <\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"194What_is_the_need_for_Azure_Data_Factory\"><\/span>194.What is the need for Azure Data Factory?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">While going through\u00a0<\/span><b>azure tutorial<\/b><span style=\"font-weight: 400;\">, you would come across this terminology. Since data comes from different sources, it can be in any form. Such varied sources will transfer or channelize the particular data in various ways and the same can be in a varied format. Whenever we convey this data on the cloud or specific storage, it is inevitable to ascertain that this data is efficiently managed. So, you have to transform the data and remove unnecessary parts.\u00a0<\/span><\/p>\n<p><span style=\"font-weight: 400;\">Sine data transfer is concerned, it is important to ascertain that data is collected from various sources and convey at a common place. Now store it and if needed, transformation needs to be done. The same can be accomplished by a conventional data warehouse too but it comes with some limitations. Occasionally, we are impelled to use custom applications that can manage all such processes distinctly. But this process consumes time and integration of all such processes is troublesome. So, it is necessary to find out an approach to automate this process or design appropriate workflows. Azure Data Factory assists you to coordinate this entire process more conveniently.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"195Is_there_any_limit_on_how_many_integration_runtimes_can_be_performed\"><\/span>195.Is there any limit on how many integration runtimes can be performed?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">No, there is no limit on the number of integration runtime occurrences you can have in an Azure data factory. However, there is a limit on the number of VM cores that the integration runtime can utilize for every subscription for SSIS package implementation. When you pursue\u00a0<\/span><b>Microsoft Azure Certification<\/b><span style=\"font-weight: 400;\">, you should be aware of these terms.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"196Explain_Data_Factory_Integration_Runtime\"><\/span>196.Explain Data Factory Integration Runtime?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Integration Runtime is a safe computing infrastructure being used by Data Factory for offering data integration abilities over various network environments. Moreover, it ascertains that such activities will get implemented in the nearest possible area to the data store. If you want to\u00a0<\/span><b>Learn Azure Step by step<\/b><span style=\"font-weight: 400;\">, you must be aware of this and other such fundamental Azure terminologies.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"197What_it_means_by_blob_storage_in_Azure\"><\/span>197.What it means by blob storage in Azure?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Blob storage in\u00a0<\/span><b>Azure<\/b><span style=\"font-weight: 400;\"> is one of the key aspects to learn if you want to get\u00a0<\/span><b>Azure fundamentals certification<\/b><span style=\"font-weight: 400;\">. Azure Blob Storage is a service very useful for the storage of massive amounts of unstructured object data like binary data or text. Moreover, you can use Blob Storage to render data to the world or for saving application data confidentially. Typical usages of Blob Storage include:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Directly serving images or documents to a browser<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Storage of files for distributed access<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Streaming audio and video<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Storing data for backup and reinstate disaster recovery, and archiving<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Storing data for investigation by an on-premises or any Azure-hosted service<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"198Mentions_the_steps_for_creating_ETL_process_in_Azure_Data_Factory\"><\/span>198.Mentions the steps for creating ETL process in Azure Data Factory?<span style=\"font-weight: 400;\"><br \/>\n<\/span><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">When attempting to retrieve some data from Azure SQL server database, if anything needs to be processed, it would be processed and saved in the Data Lake Store. Here are the steps for creating ETL:<\/span><\/p>\n<ul>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Firstly, create a Linked Service for source data store i.e. SQL Server Database<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Suppose that we are\u00a0 using a cars dataset<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Now create a Linked Service for a destination data store that is Azure Data Lake Store<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">After that, create a dataset for Data Saving<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Setup the pipeline and add copy activity<\/span><\/li>\n<li style=\"font-weight: 400;\" aria-level=\"1\"><span style=\"font-weight: 400;\">Finally, schedule the pipeline by inserting a trigger<\/span><\/li>\n<\/ul>\n<h2><span class=\"ez-toc-section\" id=\"199How_to_create_Azure_Functions\"><\/span>199.How to create Azure Functions?<b><br \/>\n<\/b><span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">Azure Functions are solutions for implementing small lines of functions or code in the cloud. With these functions, we can choose preferred programming languages. You need to pay only for the time the code runs which means that you need to pay per usage. It supports a wide range of programming languages including F#, C#, Node.js, Java, Python, or PHP. Also, it supports continuous deployment as well as integration. It is possible to develop serverless applications through Azure Functions applications. When you enroll for\u00a0<\/span><b>Azure Training In Hyderabad<\/b><span style=\"font-weight: 400;\">, you can thoroughly know how to create Azure Functions.<\/span><\/p>\n<h2><span class=\"ez-toc-section\" id=\"200What_is_Azure_SQL_Data_Warehouse\"><\/span>200.What is Azure SQL Data Warehouse?<span class=\"ez-toc-section-end\"><\/span><\/h2>\n<p><span style=\"font-weight: 400;\">It is a huge storage of data collected from a broad range of sources in a company and useful to make management decisions. These warehouses enable you to accumulate data from diverse databases existing as either remote or distributed systems.\u00a0<\/span><span style=\"font-weight: 400;\">An Azure SQL Data Warehouse can be created by integrating data from multiple sources which can be utilized for decision making, analytical reporting, etc. In other words, it is a cloud-based enterprise application allowing you to function under parallel processing to rapidly examine a complex query from the massive data volume. Also, it works as a solution for Big-Data concepts.<\/span><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p><span style=\"font-weight: 400;\">\u00a0<\/span><\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n<p>&nbsp;<\/p>\n","protected":false},"excerpt":{"rendered":"<p>ADF Interview Questions 1.Why do we need Azure Data Factory? Azure Data factory does not store any data itself; it lets you\u00a0create workflows\u00a0that orchestrate the movement of data between supported data stores and data processing. You can\u00a0monitor\u00a0and\u00a0manage\u00a0your workflows using both\u00a0programmatic\u00a0and\u00a0UI mechanisms.\u00a0Apart from that, it is the best tool available today for ETL processes with an [&hellip;]<\/p>\n","protected":false},"author":2,"featured_media":281,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[17],"tags":[],"class_list":["post-130","post","type-post","status-publish","format-standard","has-post-thumbnail","category-interview-questions"],"_links":{"self":[{"href":"https:\/\/gauthamit.com\/blog\/wp-json\/wp\/v2\/posts\/130","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/gauthamit.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/gauthamit.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/gauthamit.com\/blog\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/gauthamit.com\/blog\/wp-json\/wp\/v2\/comments?post=130"}],"version-history":[{"count":0,"href":"https:\/\/gauthamit.com\/blog\/wp-json\/wp\/v2\/posts\/130\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/gauthamit.com\/blog\/wp-json\/wp\/v2\/media\/281"}],"wp:attachment":[{"href":"https:\/\/gauthamit.com\/blog\/wp-json\/wp\/v2\/media?parent=130"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/gauthamit.com\/blog\/wp-json\/wp\/v2\/categories?post=130"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/gauthamit.com\/blog\/wp-json\/wp\/v2\/tags?post=130"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}