11. Assignment 11: Model Comparison#

11.1. Quick Facts#

11.3. Assessment#

Eligible skills: (links to checklists)

  • first chance compare 1 and 2

  • optimization 1 and 2

  • clustering 1 and 2

  • regression 1 and 2

  • classification 1 and 2

  • evaluate (must use extra metrics to earn this here) 1 and 2

  • summarize 1 and 2

  • visualize 1 and 2

11.4. Instructions#

Tip

this is best for regression or classification, but if you use clustering use the scoring parameter to pass better metrics than the default of the score method.

Hint

See the questions to consider in A10 for more detail on what to consider when optimizing each model.

If you are skipping submitting A10, follow those instructions for each model.

Choose a dataset, it can be appropriate for classification, regression, or clustering. Optimize at least two models for the same task and choose the appropriate metrics to compare the fit. Decide which model you would recommend based on a realistic setting for that dataset and include evidence justifying that choice. Summarize your findings with plots and tables as appropriate.

You can reuse a dataset you’ve used for one of the previous assignments or choose a new dataset.

Think Ahead

How would this decision making compare for a more complex model or in more realistic setting.