ChatGPT解决这个技术问题 Extra ChatGPT

How to exclude certains columns while using eloquent

When I'm using eloquent, I can use the "where" method then the method 'get' to fill an object containing what I've selected in my database. I mean:

$users = User::where('gender', 'M')->where('is_active', 1)->get(['pseudo', 'email', 'age', 'created_at'])->toArray();

Here I can choose the columns I want to get like 'pseudo', 'email', etc.. But what I miss in laravel doc is the way to do the contrary. It could be something like that:

$users = User::where('gender', 'M')->where('is_active', 1)->notGet(['pseudo', 'email', 'age', 'created_at'])->toArray();

Thank you for you futur answer and have a nice day.

The question is, why you want to do that? Using ORM you'd rather not do it, and if you just don't want to show some of the columns, there are other ways to achieve that.
I ask it because when you have 15 columns and you want 13, It could be faster to do something like ->notGet(['column14', 'column15']); instead of ->get(['column1', 'column2', [...], 'column13']);. You see ?

R
Razor

If you only need to hide attributes from your model's array or JSON representation, you may use one or both approaches:

Add the $hidden property to your model class User extends Model { /** * The attributes that should be hidden for arrays. */ protected $hidden = ['password']; }

Use the makeHidden function $users = $users->makeHidden(['address', 'phone_number']);

See other answers for more details... But sometimes you don't want to load huge data (geospatial, html, logs...) into your application, it will be slow and take more memory. OP asked for an SQL query hence my answer, but most of the time it's more convenient to only hide the data from the JSON response.

AFAIK there is no build in option in SQL to exclude columns explicitly, so Laravel can't do it. But you can try this trick

Update

Another trick is to specify all columns in your model (or use an extra query to get all columns using $this->getTableColumns() from this answer, it can also be cached after each migration to avoid two queries) then add a local scope function

// The below code requires you to define all columns in $columns.
// A better approach is to query the schema of the table and cache it after each  
// migration, for more details: https://stackoverflow.com/a/56425794/3192276

protected $columns = ['id','pseudo','email'];

public function scopeExclude($query, $value = []) 
{
    return $query->select(array_diff($this->columns, (array) $value));
}

Then you can do :

$users = User::where('gender', 'M')
    ->where('is_active', 1)
    ->exclude(['pseudo', 'email', 'age', 'created_at'])
    ->toArray();

->exclude ? This will result in method not allowed.
@Leon The above model function scopeExclude() is called like that. Read about laravel scopes on laravel.com/docs/5.3/eloquent#local-scopes
This method does not works when chained with eager relationship loading : the model itself returns the correct column without the exluded ones, but relationships fail to be retrieved.
@ChristosLytras I'm not aware of any other workaround, as I said it's an SQL limitation, so Laravel can't do it with one query. The overall consensus in all DBMS is query the schema so you may define an sql function or procedure or a view... You may also cache the result of Schema::getColumnListing('table') and clear it on each migration, that way you avoid an extra SQL query.
hey @Razor I have updated my answer to cache support
i
iamab.in

using hidden array in model is good, but if you don't want to hide your column all the time and use makeVisible to access them in need, then instead, hide your column from serialization where you need with makeHidden function like this :

$res = Model::where('your query')->get();
$res->makeHidden(['column_one','column_two','column_n']);
return response()->json($res);

This is not usefull if that column is large, you still will be querying it, the idea is NOT to query it. I have a table with a column that is a shape geometry, each value is like 500KB, I have to call like 100 objects of that model, I need to exceptit in my query.
Depend on the usage, I need to hide created_at, updated_at, deleted_at, this answer is the most perfect for me.
This answer is best if you want for example hide one field from serialization.
This is the best solution for me as well. You can also serialize them like Model::first()->relationship->makeHidden(['field1', 'field2']);
Call to undefined method Illuminate\Database\Eloquent\Relations\HasMany::makeHidden()
C
Christhofer Natalius

I don't know about previous Laravel version, but in 5.4 you can put this line in User model

protected $hidden = ['pseudo', 'email', 'age', 'created_at'];

and then User::find(1); will return all fields except pseudo, email, age, and created_at.

But you still can retrieve those hidden fields by using:

$user = User::find(1);
$email = $user['email']; // or $user->email;

also available in Laravel 5.1
It hides it from output (toArray(), toJSON()) but still loads it from DB, so this approach is useless when you need to not load certain data
@Stalinko If you have certain data in the model you do not want to load at all by default it sounds like you should split up the resources and use relationships.
@kb, I won't agree. Splitting resources and using relationships is a very hard solution, for most complicated cases only. In real life it's pretty common task to load only currently required columns. For example there can be heavy description column which is necessary only when you load a single model, but not necessary when you load all the models. Skipping it saves a lot of memory.
@Stalinko I only partially agree with that. I see your point, but I feel that is the responsibility of a collection to limit the dataset where you need to process a lot of it/there are computational resources to save in only using specific fields. A model should be predictable and atomic, and for special cases where you still need it there are many ways to filter the object/load it by direct queries/builders. If you have [esp large] data fields in your models you often don't want to load it should probably be in a separate model.
M
ManojKiran Appathurai

I have looked into the answer by @Razor

But there is Very Conveinent way by skipping $columns property

 /**
 * Scope a query to only exclude specific Columns.
 *
 * @author Manojkiran.A <manojkiran10031998@gmail.com>
 * @param  \Illuminate\Database\Eloquent\Builder $query
 * @return \Illuminate\Database\Eloquent\Builder
 */
public function scopeExclude($query, ...$columns)
{
    if ($columns !== []) {
        if (count($columns) !== count($columns, COUNT_RECURSIVE)) {
            $columns = iterator_to_array(new \RecursiveIteratorIterator(new \RecursiveArrayIterator($columns)));
        }

        return $query->select(array_diff($this->getTableColumns(), $columns));
    }
    return $query;
}

/**
 * Shows All the columns of the Corresponding Table of Model
 *
 * @author Manojkiran.A <manojkiran10031998@gmail.com>
 * If You need to get all the Columns of the Model Table.
 * Useful while including the columns in search
 * @return array
 **/
public function getTableColumns()
{
    return \Illuminate\Support\Facades\Cache::rememberForever('MigrMod:' . filemtime(database_path('migrations')), function () {
        return $this->getConnection()->getSchemaBuilder()->getColumnListing($this->getTable()); 
    });
}

getTableColumns function will get all the columns of the table so you dont need to define the $column property

NOTE: COLUMN NAMES OF TABLE WILL BE CACHED UNTIL CONTENTS OF MIGRATIONS DIRECTORY IS ADDED OR DELETED.

MODIFYING THE CONTENTS OF FILES INSIDE THE MIGRATIONS DIRECTORY WILL NOT RE-CACHE THE COLUMNS

To clear cache manually you can run php artisan cache:clear


I like your approach, as it is reusable in any Model. The only downside is the getTableColumns() method causing one extra query to DB... but, if that is not a problem (small apps), it's OK
Yeah as you said it will make one extra db query but if you application is small you can use my approach but for enterprise application you can store column names in cache . Whenever you make a new deployment you can clear the cache.
Yes that's a better approach, you can avoid an extra query by caching the result after each migration, I will link to your answer.
v
vuhung3990

you can use hidden array like this:

class Promotion extends Model
{
    protected $table = 'promotion';
    protected $hidden = array('id');
}

R
Rafael Xavier

We get the object eloquent from the model full with all fields, transform it to array and we put it inside of a collection. Than we get all fields except all fields specified in array $fields.

$fields = ['a', 'b', 'c', 'N'];
$object = Model::find($id);
return collect($object->toArray())->except($fields);

More clearly, let's give an example:

// Array of fields you want to remove
$fields_to_remove = ['age', 'birthday', 'address'];

// Get the result of database
$user = User::find($id);

// Transform user object to array
$user = $user->toArray();

// Create a collection with the user inside
$collection = collect($user);

// Get all fields of our collection except these fields we don't want
$result = $collection->except($fields_to_remove);

// Return
return $result;

This example above makes exactly the same thing of the first one, but it's more explained.


This one works except that you fetch it from the database to begin with. the main purpose i would want to exclude some staff is so that i do not get huge data from the database
B
Brad Ahrens

I have a solution that worked for me, which is slightly different than those already stated.

Solution:

$all_columns = Schema::getColumnListing('TABLE_NAME');
$exclude_columns = ['COLUMN_TO_EXCLUDE_1', 'COLUMN_TO_EXCLUDE_2'];
$get_columns = array_diff($all_columns, $exclude_columns);

return User::select($get_columns)->get();

Reasoning:

For me:

Razor's answer didn't work as I got the following error:

BadMethodCallException with message 'Call to undefined method App/CaseStudy::exclude()'

Then, the remaining answers were attemping to hide the columns within the model. Unfortunately, that would hide them for each method in my class and this isn't something that I wanted.

So, in the end, I modified Razor's solution so that it would work without having to hide any of the columns for each method.

I hope this helps someone! 😊


M
Mohamed Hany

you can use makeHidden array like this: (After get() or all())

$users = User::where('gender', 'M')->where('is_active', 1)->get()->makeHidden(['pseudo', 'email', 'age', 'created_at'])->toArray();


a
alisongaleon

You can leverage Illuminate\Support\Facades\Schema::getColumnListing('table_name');

use Illuminate\Support\Facades\Schema;

$users_table_columns = Schema::getColumnListing('users');

$exclude_columns = [
 'password',
 'token',
 'address',
];
        
$select = array_diff($users_table_columns, (array) $exclude_columns);

$site = User::select($select)
 ->where('gender', 'M')
 ->where('is_active', 1)
 ->first();

d
dastan

You can use unset unset($category->created_at,$category->updated_at);

$fcategory = array();
$kCategory = KCategory::where("enabled", true)->get();
foreach ($kCategory as $category) {
    $subkCategory = PostCategory::select("id", "name", "desc")
        ->where("id_kcategory", $category->id)
        ->where("enabled", true)
        ->get();

    unset($category->created_at, $category->updated_at);

    $fcategory[] = $category;
}

Its worked for me in "laravel/lumen-framework": "5.7.8"
This is done on php end on MySQL/DB end. You are still fetching all the columns from DB. This is just removing(unset) the data from the collections of already fetched data.
yes, correct, fetching all data from DB but removing a field from the collection using unset, but I don't know why it's not working for others, and its downvoted. it's excluding filed.
it is because we have already got the non required column data on memory. For a small application or if the column has a small data size then it will not be an issue. If you can optimize on database end then that should always be the priority.
Ya but if its require in one API but not in another API